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How to read do mathematics 


Reading mathematics is not the same as reading a novel—it’s more fun, and more 


interactive! To read mathematics you need 
(a) a pen, 
(b) plenty of blank paper, and 
(c) the courage to write down everything—even “obvious” things. 


As you read a math book, you work along with me, the author, trying to anticipate 
my next thoughts, repeating many of the same calculations I did to write this book. 
You must write down each expression, sketch each graph, and constantly think 
about what you are doing. You should work examples. You should fill-in the details 
I left out. This is not an easy task; it is hard work, but, work that is, I very much 
hope, rewarding in the end. 

Mathematics is not a passive endeavor. I may call you a “reader” but you are 
not reading; you are writing this book for yourself. 


—the so-called “author” 
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Introduction, or. . . what is this all about? 


Consider the following sum: 


1 1 1 1 1 
i i | fe. -f--- 


Die ea sis a 
The dots at the end indicate that the sum goes on forever. Does this make sense? 


Can we assign a numerical value to an infinite sum? While at first it may seem 
difficult or impossible, we have certainly done something similar when we talked 
about one quantity getting “closer and closer” to a fixed quantity. Here we could 
ask whether, as we add more and more terms, the sum gets closer and closer to 


some fixed value. That is, look at 
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and so on, and ask whether these values have a limit. They do; the limit is 1. In 
fact, as we will see, 
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and then 
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This is less ridiculous than it appears at first. In fact, you might already believe 


that 
~ 3 3 3 3 1 
0.33333 = + } } is 
10 100 1000 10000 3 


which is similar to the sum above, except with powers of ten instead of powers of two. 


And this sort of thinking is needed to make sense of numbers like m, considering 


ae 1 5 9 
3.14159...=34 be =O, 
10 | 100 | 1000 10000 ' 100000 


Before we investigate infinite sums—usually called series—we will investigate 


limits of sequences of numbers. That is, we officially call 


= 1 ee! | 1 | 1 i 1 | i 1 i 
ae ye or 
=k 
a series, while ; 
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is a sequence. The value of a series is the limit of a particular sequence, that is, 


If this all seems too obvious, let me assure you that there are twists and turns 
aplenty. And if this all seems too complicated, let me assure you that we'll be going 
over this in much greater detail in the coming weeks. In either case, I hope that 


youll join us on our journey. 


1 Sequences 


1.1 Notation 


A “sequence” of numbers is just a list of numbers. For example, here is a list of 


numbers: 


Note that numbers in the list can repeat. And consider those little dots at the 


end! The dots “...” signify that the list keeps going, and going, and going—forever. 


? 


Presumably the sequence continues by following the pattern that the first few “terms” 
suggest. But what’s that pattern? 

To make this talk of “patterns” less ambiguous, it is useful to think of a sequence 
as a function. We have up until now dealt with functions whose domains are the 
real numbers, or a subset of the real numbers, like f(x) = sin(1/x). 

A real-valued function with domain the natural numbers IN = {1,2,3,...}isa 
sequence. 

Other functions will also be regarded as sequences: the domain might include 
O alongside the positive integers, meaning that the domain is the non-negative 
integers, Z2° = {0O, 1,2,3,...}. The range of the function is still allowed to be the 
real numbers; in symbols, the function f: IN — R is a sequence. 


Sequences are written down in a few different, but equivalent, ways; you might 


Maybe you are feeling that this formality is unnec- 
essary, or even ridiculous; why can’t we just list off 
a few terms and pick up on the pattern intuitively? 
As we'll see later, that might be very hard—nay, 
impossible—to do! There might be very different— 
but equally reasonable—patterns that start the same 
way. 

To resolve this ambiguity, it is perhaps not so 
ridiculous to introduce the formalism of “functions.” 
Functions provide a nice language for associating 
numbers (terms) to other numbers (indices). 
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see a sequence written as 


depending on which author you read. Worse, depending on the situation, the 
same author (and this author) might use various notations for a sequence! In this 


textbook, I will usually write (a,) if I want to speak of the sequence as a whole 


(think gestalt) and I will write a, if1 am speaking of a specific term in the sequence. 


Let’s summarize the preceding discussion in the following definition. 


Definition A sequence (a,) is, formally speaking, a real-valued function with 
domain 


{née Z:n=N}, for some integer N. 


Stated more humbly, a sequence assigns a real number to the integers starting 
with an index N. 

The “outputs” of a sequence are the terms of the sequence; the “n™ term” is 
the real number that the sequence associates to the natural number n, and 
is usually written aj. The n in the phrase “n™ term” is called an index; the 
plural of index is either indices or indexes, depending on who you ask. The 
first index N is called the initial index. 


Warning Usually the “domain” of a sequence is IN and Z?°. But depending 
on the context, it may be convenient for a sequence to start somewhere else— 
perhaps with some negative number. We shouldn’t let the usual situation of INN 
on Z* get in the way of making the best choice for the problem at hand. 


Recall that the natural numbers IN are the counting 
numbers 1,2,3,4,.... If we want our sequence to 
start at zero, we use Z~° as the domain instead. 
The fancy symbols Z>° refer to the non-negative 
integers, which include zero (since zero is neither 
positive nor negative) and also positive integers (since 
they certainly aren’t negative). 

To confuse matters further, some people—especially 
computer scientists—might include zero in the natu- 
ral numbers IN. Mathematics is cultural. 


As you can tell, there is a deep tension between precise definition and a vague 
flexibility; as instructors, how we navigate that tension will be a big part of whether 
we are successful in teaching the course. We need to invoke precision when we’re 
tempted to be too vague, and we need to reach for an extra helping of vagueness 
when the formalism is getting in the way of our understanding. It can be a tough 


balance. 


1.2 Defining sequences 


1.2.1 Defining sequences by giving a rule 


Just as real-valued functions from Calculus One were usually expressed by a 
formula, we will most often encounter sequences that can be expressed by a 
formula. In the Introduction to this textbook, we saw the sequence given by the rule 


a; = f (i) = 1-1/2". Other examples are easy to cook up, like 


aj = ’ 

i+1 
i 
= 


Cn = sin(nn/6), or 


(i- 1)(i+ 2) 


d; = gi 


Frequently these formulas will make sense if thought of either as functions with 
domain R or WN, though occasionally the given formula will make sense only for 
integers. We'll address the idea of a real-valued function “filling in” the gaps between 


the terms of a sequence when we look at graphs in Section 1.5. 


Warning A common misconception is to confuse the sequence with the rule 
for generating the sequence. The sequences (a,,) and (by) given by the rules 
a, = (-1)" and b, = cos(mn) are, despite appearances, different rules which 
give rise to the same sequence. These are just different names for the same 
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object. 


Let’s give a precise definition for “the same” when speaking of sequences. 


Definition Suppose (a,) and (b,) are sequences starting at 1. These se- 
quences are equal if for all natural numbers n, we have an = bn. 

More generally, two sequences (a,;,) and (bn) are equal if they have the same 
initial index N, and for every integer n > N, the n™ terms have the same value, 
that is, 

Gk = lo}, stone ull ah SIN 


In other words, sequences are the same if they have the same set of valid indexes, 
and produce the same real numbers for each of those indexes—regardless of whether 
the given “rules” or procedures for computing those sequences resemble each other 


in any way. 


1.2.2 Defining sequences using previous terms 


Another way to define a sequence is recursively, that is, by defining the later outputs 
in terms of previous outputs. We start by defining the first few terms of the sequence, 


and then describe how later terms are computed in terms of previous terms. 
Example 1.2.1 Define a sequence recursively by 
aq,=1, a@=3, ag=10, 
and the rule that a, = an-1 — An-3. Compute as. 


Solution First we compute ay. Substituting 4 for n in the rule ay = ap_1 — 
An-3, we find 


Q4 = d4_-] — Q4-3 = G3 —Q). 


But we have values for ag and a;, namely 10 and 1, respectively. Therefore 
a, = 10-1=9. 


Now we are in a position to compute as. Substituting 5 for n in the rule 


Compare this to equality for functions: two func- 
tions are the same if they have same domain and 
codomain, and they assign the same value to each 
point in the domain. 


You might be familiar with recursion from a computer 
science course. 


An = An—-1 — An_3, We find 
a5 = 45-1 — 45-3 = 44— a2. 


We just computed ay = 9; we were given a2 = 3. Therefore ag =9-3=6. 


1.3 Examples 


Mathematics proceeds, in part, by finding precise statements for everyday concepts. 


We have already done this for sequences when we found a precise definition 
(“function from IN to RR”) for the everyday concept of “a list of real numbers.” But 
all the formalisms in the world aren’t worth the paper they are printed on if there 
aren’t some interesting examples of those precise concepts. Indeed, mathematics 
proceeds not only by generalizing and formalizing, but also by focusing on specific, 
concrete instances. So let me share some specific examples of sequences. 

But before I can share these examples, let me address a question: how can I 
hand you an example of a sequence? It is not enough just to list off the first few 


terms. Let’s see why. 
Example 1.3.1 Consider the sequence (a;) 
Ge =4), ch=43, Gh =47, Ga = BS, 
What is the next term a5? Can you identify the sequence? 


Solution In spite of many so-called “intelligence tests” that ask questions just 
like this, this question simply doesn’t have an answer. Or worse, it has too 
many answers! 

This sequence might be “the prime numbers in order, starting at 41.” If 
that’s the case, then the next term is ag = 59. But maybe this sequence is the 
sequence given by the polynomial ay = n*—n-+4l. If that’s the case, then 
the next term is a5 = 61. Who is to say which is the “better” answer? 


Now let’s consider two popular “families” of sequences. 
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You can imagine some very complicated sequences 
defined recursively. Make up your own sequence 
and share it with your friends! Use the hashtag 
#sequence. 


Tons of entertaining sequences are listed in the The 
On-Line Encyclopedia of Integer Sequences. 


This particular polynomial n? — n+ 41 is rather inter- 
esting, since it outputs many prime numbers. You 
can read more about it at the OEIS. 


Recall that a prime number is an integer greater 
than one that has no positive divisors besides itself 
and one. 
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1.3.1 Arithmetic sequences 


The first family! we consider are the “arithmetic” sequences. Here is a definition. 


Definition An arithmetic progression (sometimes called an arithmetic se- 
quence) is a sequence where each term differs from the next by the same, fixed 
quantity. 


Example 1.3.2 An example of an arithmetic progression is the sequence (ap) 


which begins 
a; = 10, a=14, ag=18, aq = 22, 
and which is given by the rule a, = 6+4n. Each term differs from the 


previous by four. 


In general, an arithmetic progression in which subsequent terms differ by m can 
be written as 


an = m(n-1)+aq. 


Alternatively, we could describe an arithmetic progression recursively, by giving a 
starting value a), and using the rule that an = an_-) +m. 


An arithmetic progression can decrease; for instance, 
7, iy, NS, LL), 
is an arithmetic progression. 


1.3.2 Geometric sequences 


The second family we consider are geometric progressions. 


‘Mathematically, the word family does not have an 
entirely precise definition; a family of things is a 
collection or a set of things, but family also has a 
connotation of some sort of relatedness. 


Why are arithmetic progressions called arithmetic? 
Note that every term is the arithmetic mean, that 
is, the average, of its two neighbors. 


Definition A geometric progression (sometimes called a geometric sequence) 
is a sequence where the ratio between subsequent terms is the same, fixed 
quantity. 


Example 1.3.3 An example of a geometric progression is the sequence (an) 
starting 
a; =10, a2 =30, ag=90, ay = 270, 


and given by the rule a, = 10-3""!. Each term is three times the preceding 


term. 


In general, a geometric progression in which the ratio between subsequent terms 
is r can be written as 


Gp ott es 


Alternatively, we could describe a geometric progression recursively, by giving a 
starting value a), and using the rule that ay = r- ay-}. 
A geometric progression needn’t be increasing. For instance, in the following 


geometric progression 


7 7 7 7 7 7 
5’ 10°’ 20° 40’ 80’ 160’ 
the ratio between subsequent terms is one half, and each term is smaller than the 


previous. 


1.3.3 Triangular numbers 


The sequence of triangular numbers (T,,) is a sequence of integers counting the 
number of dots in increasingly large “equilateral triangles” built from dots. The term 


Tn is the number of dots in a triangle with n dots to a side. 


There are a couple of ways of making this discussion more precise. Given an 
equilateral triangle with n dots to a side, how many more dots do you need to build 
the equilateral triangle with n+ 1 dots to a side? All you need to do to transform 


the smaller triangle to the larger triangle is an additional row of n+ 1 dots placed 
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Why are geometric progressions called geometric? 
Note that every term is the geometric mean of its 
two neighbors. The geometric mean of two numbers 
a and bis defined to be Vab. 

Of course, that raises another question: why is 
the geometric mean called geometric? One geometric 
interpretation of the geometric mean of a and b is 
this: the geometric mean is the side length of a 
square whose area is equal to that of the rectangle 
having side lengths a and b. 
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along any side. Therefore, 
Th+1 = Th SF (n+ 1). 
Since T; = 1, this recursive definition suffices to determine the whole sequence. 


But there are other ways of computing T,,. Indeed, you may recall the explicit 


formula 
n:-(n+1) 


Th = 5 


from Calculus One. 


1.3.4. Fibonacci numbers 
The Fibonacci numbers are defined recursively, starting with 
Fo = Oand Fj = 1 
and the rule that F, = Fy_-1 + Fnh_2. We can restate this formula in words, instead 


of symbols; stated in words, each term is the sum of the previous two terms. So the 


sequence of Fibonacci numbers begins 


and continues. 


This is certainly not the last time we will see the Fibonacci numbers. 


Tg = 21 


Figure 1.1: The first six triangular numbers 


The Fibonacci numbers are interesting enough that 
a journal, The Fibonacci Quarterly is published 
four times yearly entirely on topics related to the 
Fibonacci numbers. 


1.3.5 Collatz sequence 


Here is a fun sequence with which to amuse your friends—or distract your enemies. 


Let’s start our sequence with a; = 6. Subsequent terms are defined using the rule 


Grant/a2 if aj_) is even, and 
ap = 
3an-1 +1 if ay_) is odd. 
Let’s compute dg. Since a, is even, we follow the instructions in the first line, to find 
that ag = a; /2 = 3. To compute ag, note that ag is odd so we follow the instruction 


in the second line, and ag = 3a, +1=3-3+1= 10. Since ag is even, the first 


line applies, and a, = a3/2 = 10/2 = 5. But ay is odd, so the second line applies, 


and we find a5 = 3-5+ 1 = 16. And as is even, so ag = 16/2 = 8. And ag is even, 
so @7 = 8/4 = 4. And a7 is even, so ag = 4/2 = 2, and then ag = 2/2 = 1. Oh, 
but ag is odd, so ajp = 3-:1+1=4. And it repeats. Let’s write down the start of 


this sequence: 


repeats 


= 
G23 LORD Gy Si) ae A Dl eA De ee. 


What if we had started with a number other than six? What if we set ay = 25 but 
then we used the same rule? In that case, since a; is odd, we compute ag by finding 
3a; +1=3-25+1= 76. Since 76 is even, the next term is half that, meaning 


ag = 38. If we keep this up, we find that our sequence begins 


25, 76, 38, 19, 58, 29, 88, 44, 22, 11, 34, 17, 52, 26, 
is, 40, 20, 10, & Ie & 4 2 i, 


and then it repeats “4, 2, 1, 4, 2, 1, ...” just like before. 

Does this always happen? Is it true that no matter which positive integer you 
start with, if you apply the half-if-even, 3x + 1-if-odd rule, you end up getting stuck 
in the “4, 2, 1,...” loop? That this is true is the Collatz conjecture; it has been 
verified for all starting values below 5 x oem Nobody has found a value which doesn’t 
return to one, but for all anybody knows there might well be a very large initial value 
which doesn’t return to one; nobody knows either way. It is an unsolved problem? 


in mathematics. 
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If you think you have an argument that answers 

the Collatz conjecture, I challenge you to try your 

hand at the 5x + 1 conjecture, that is, use the rule 
| an-1/2 if an_) is even, and 

a ( QAn-1 +1 if ap_; is odd. 


? This is not the last unsolved problem we will en- 
counter in this course. There are many things which 
humans do not understand. 
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1.4 Where is a sequence headed? Take a limit! 


We've seen a lot of sequences, and already there are a few things we might notice. 


For instance, the arithmetic progression 
i 85) 15," 225, 295 36; 43550) 57, 64. 71 78; 985, 92; 


just keeps getting bigger and bigger. No matter how large a number you think of, if 
I add enough 7’s to 1, eventually I will surpass the giant number you thought of. 
On the other hand, the terms in a geometric progression where each term is half 


the previous term, namely 


1 1 1 1 1 1 1 1 1 1 
DR a Ss ie B2° Bl 19” Os wily’ lop” ~~~ 


are getting closer and closer to zero. No matter how close you stand near but not at 
zero, eventually this geometric sequence gets even closer than you are to zero. 

These two sequences have very different stories. One shoots off to infinity; the 
other zooms in towards zero. Mathematics is not just about numbers; mathematics 
provides tools for talking about the qualitative features of the numbers we deal 
with. What about the two sequences we just considered? They are qualitatively very 
different. The first “goes to” infinity; the second “goes to” zero. 

In short, given a sequence, it is helpful to be able to say something qualitative 
about it; we may want to address the question such as “what happens after a while?” 
Formally, when faced with a sequence, we are interested in the limit 


lim f(i) = lim a. 


ico i-0o 
In Calculus One, we studied a similar question about 


lim f(x) 


x 0o 


when x is a variable taking on real values; now, in Calculus Two, we simply want to 
restrict the “input” values to be integers. No significant difference is required in the 
definition of limit, except that we specify, perhaps implicitly, that the variable is an 


integer. 


If you were with us in Calculus One, you are perhaps 
already guessing that by “goes to,” I actually mean 
“has limit.” 


Definition Suppose that (a,) is a sequence. To say that Jim, an = Lis to say 
that 
for every <> 0, 
there is an N> 0, 
so that whenever n> N, 
we have |dp — L| < e. 
If lim an = L we say that the sequence converges. If there is no finite value L 


n—-oo 


so that lim a, = L, then we say that the limit does not exist, or equivalently 


n—oo 


that the sequence diverges. 


Warning In the case that lim a, = ©, we say that (a,) diverges, or perhaps 


n—-0oo 


more precisely, we say (a,) diverges to infinity. The only time we say that a 
sequence converges is when the limit exists and is equal to a finite value. 


One way to compute the limit of a sequence is to compute the limit of a function. 


Theorem 1.4.1 Let f(x) be a real-valued function. If a, = f(n) defines 
a sequence (a,) and if lim f(x) = L in the sense of Calculus One, then 
x7 0CO 


lim a, = L as well. 
n—-coo 


Example 1.4.2 Since lim (1/x) = 0, it is clear that also lim (1/n) = 0; in 
x— 00 n—-oo 
other words, the sequence of numbers 
rt id iad ag dt 
i @ @ 
get closer and closer to O, or more precisely, as close as you want to get to zero, 
after a while, all the terms in the sequence are that close. 


More precisely, no matter what ¢ > O we pick, we can find an N big enough 


so that, whenever n > N, we have that 1/n is within ¢ of the claimed limit, 
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The definition of limit is being written as if it were 
poetry, what with line breaks and all. Like the best 
of poems, it deserves to be memorized, performed, 
internalized. Humanity struggled for millenia to find 
the wisdom contained therein. 
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zero. This can be made concrete: let’s suppose we set ¢ = 0.17. What is a 
suitable choice for N in response? If we choose N = 5, then whenever n> 5 
we have 0 < 1/n< 0.17. 


But it is important to note that the converse® of this theorem is not true. To 
show the converse is not true, it is enough to provide a single example where it fails. 


Here’s the counterexample’. 


Example 1.4.3 Consider the sequence (a,) given by the rule a, = f(n) = 


sin(n7). This is the sequence 
sin(Om), sin(17m), sin(27), sin(3z), ..., 


which is just the sequence 0,0,0,0,... since sin(nz) = O whenever n is an 
integer. Since the sequence is just the constant sequence, we have 


him yf (7) = lim: 00; 


no n—-oo 


But lim f(x), when x is real, does not exist: as x gets bigger and bigger, 
x00 


the values sin(xz) do not get closer and closer to a single value, but instead 


oscillate between —1 and 1. 


Here’s some general advice. If you want to know im, Aan, you might first think 
of a function f(x) where a, = f(n), and then attempt to compute Jim f (x). If the 
limit of the function exists, then it is equal to the limit of the sequence. But, if 
for some reason iim f(x) does not exist, it may nevertheless still be the case that 


lim f(n) exists—you'll just have to figure out another way to compute it. 
n—-oo 


1.5 Graphs 


It is occasionally useful to think of the graph of a sequence. Since the function is 
defined only for integer values, the graph is just a sequence of dots. In Figure 1.2 we 
see the graph of a sequence and the graph of a corresponding real-valued function. 

There are lots of real-valued functions which “fill in” the missing values of a 


sequence. 


° The converse of a statement is what you get when 
you swap the assumption and the conclusion; the 
converse of “if it is raining, then it is cloudy” is the 
statement “if it is cloudy, then it is raining.” Which 
of those statements is true? 

* An instance of (a potential) general rule being bro- 
ken is called a counterexample. This is a popular 
term among mathematicians and philosophers. 


an 


Figure 1.2: Plots of f(x) = cos(mx) + (4/5)* and 
the sequence a, = (-—1)" + (4/5)”. 


>xandn 


Example 1.5.1 Here’s a particularly tricky example of “filling in” the missing 


values of a sequence. Consider the sequence 
1, 2, 6, 24, 120, 720, 5040, 40320, 362880, ..., 


where the n™ term is the product of the first n integers. In other words ay = nl, 
where the exclamation mark denotes the factorial function. Explicitly describe 


a function f of a real variable x, so that a, = f(n) for natural numbers n. 
Solution There are lots of solutions. Here is a solution: 
HiG2) = (ell. 


In that definition, |x] denotes the “greatest integer less than or equal to x” and 
is called the floor function. This is shown in Figure 1.3. 

On the other hand, there are much trickier things that you could try to do. 
If you define the Gamma function 


re) = [ te dt. 
0 


then it is perhaps very surprising to find out that g(x) =I'(x+ 1) is a function 
so that g(n) = n! for natural numbers n. A graph is shown in Figure 1.4. 


Unlike f, which fails to be continuous, the function g is continuous. 


1.6 New sequences from old 


Given a sequence, one way to build a new sequence is to start with the old sequence, 
but then throw away a whole bunch of terms. For instance, if we started with the 


sequence of perfect squares 
Il, 4 & 16, 2 38 2 & Si, 
we could throw away all the odd-indexed terms, and be left with 


4, 16, 36, 64, 100, 144, 196, 256, 324, 400, 484, 
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Figure 1.3: A plot of f(x) = |x]! and a, = n!. Recall 
that, by convention, 0! = 1. 


It is hard to define the “greatest integer” function, 
because they are all pretty great. 


| } } —> xandn 
1 2 3 4 
Figure 1.4: Plots of f(x) = ‘i Hen dt. and a, = 


0 
ni. 
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We say that this latter sequence is a subsequence of the original sequence. Here is 


a precise definition. 


Definition Suppose (a,) is a sequence with initial index N, and suppose we 


have a sequence of integers (n;) so that 
N<nm<n<n<m<n5<::: 


Then the sequence (b;) given by b; = an, is said to be a subsequence of the 


sequence ap. 


Limits are telling the story of “what happens” to a sequence. If the terms of a 
sequence can be made as close as desired to a limiting value L, then the subsequence 


must share that same fate. 


Theorem 1.6.1 If (b;) is a subsequence of the convergent sequence (a,), then 


lim b; = lim ay. 


i—0oo n—0oo 


Of course, just because a subsequence converges does not mean that the larger 
sequence converges, too. We'll see this again in more detail when we get to 


Example 1.7.6, but we'll discuss it briefly now. 


Example 1.6.2 Find a convergent subsequence of the sequence (an) given by 


the rule an = (-1)". 


Solution Note that the sequence (a,,) does not converge. But by considering 


the sequence of indexes n; = 2- i, we can build a subsequence 
= = = Dh 
bi = An, = agi = (-1) — ale 


which is a constant sequence, so it converges to 1. 


There are other subsequences of aj = (—1)" which converge but do not converge 
to one. For instance, the subsequence of odd indexed terms is the constant sequence 
Cn = —1, which converges to —1. For that matter, the fact that there are convergent 
subsequences with distinct limits perhaps explains why the original sequence (a,) 
does not converge. Let’s formalize this. 


Corollary 1.6.3 
Suppose (b;) and (cj) are convergent subsequences of the sequence (an), 
but 


lim b; # lim Gi 


i-0o 


Then the sequence (an) does not converge. 


Proof Suppose, on the contrary, the sequence (ap) did converge. Then by 
Theorem 1.6.1, the subsequence (b;) would converge, too, and 


lim b; = lim ap. 


i- 00 n—-oo 


Again by Theorem 1.6.1, the subsequence (c;) would converge, too, and 


lim c; = lim ay. 
i- 00 n-oo 
But then lim b; = lim cj, which is exactly what we are supposing doesn’t 
i-co — 00 


t 
happen! To avoid this contradiction, it must be that our original assumption that 


(an) converged was incorrect; in short, the sequence (a,) does not converge. 


1.7 Helpful theorems about limits 


Not surprisingly, the properties of limits of real functions translate into properties 


of sequences quite easily. 
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Theorem 1.7.1 Suppose that lim a, = L and lim b; = M and k is some 
n—-co noo 


constant. Then 


lim ka, = k lim ay, = kL, 


n—-co n—-co 
lim (an + bn) = lim an + lim b, =L+M, 
n—-00 n-oo nm—+oo 
lim (ap — bn) = lim an —- lim bh = L-M, 
n—-oo n—-oo n-oco 
lim (anbp) = lim ap: lim by = LM, and 
n—-co n-oco n—-co 

a limpsoo @, L 
ti = — r=, provided M # O. 
n>0 Dp ND ayes 1 M 


1.7.1 Squeeze Theorem 


Likewise, there is an analogue of the squeeze theorem for functions. 


Theorem 1.7.2 Suppose there is some N so that for all n> N, it is the case 
10 6-1 6 Sal 0 i Oo 


, then lim b, = 


n—-oo 


hin @ = him & Jb 
n—-oo 


n—-0oo 


ID; 


And a final useful fact: 


Theorem 1.7.3 lim |a,| = 0 if and only if lim a, = 0. 
n—-co n—-oo 


This says simply that the size of a, gets close to zero if and only if a, gets close 


to zero. 


Sometimes people write “iff as shorthand for “if and 
only if.” 


1.7.2. Examples 


Armed with these helpful theorems, we are now in a position to work a number of 


examples. 


Example 1.7.4 Determine whether the sequence (a,) given by the rule ay = 
n 


converges or diverges. If it converges, compute the limit. 


n+1 


Solution Consider the real-valued function 


x 
x1 


f(x) = 


Since an = f(n), it will be enough to find lim f(x) in order to find lim an. We 


xX 00 noo 
compute, as in Calculus One, that 


Xe x+1)-1 
lim = ee a ) 
x00 x + ] x00 x+1 
Xa el 1 
= lim ( — 
seo Seae il s¢se 1 
1 
= lim (1- 
x00 x+1 
} : 1 
= lim 1- lim 
x00 x0 x + ] 
=1- lim = 1 =@ = il 
x0 x + ] 


We therefore conclude that lim a, = 1. 


n—-oo 


logn 


Example 1.7.5 Determine whether the sequence (a,) given by an = 


converges or diverges. If it converges, compute the limit. 


Solution By l’Hopital’s rule, we compute 
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And this is reasonable: by choosing n to be a large 
as close to 1 as I 
10000000000 
10000000001 


enough integer, I can make 


would like. Just imagine how close 
is to one. 
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Therefore, 


I’m not too fond of l’H6pital’s rule, so I would have 
been happier if I had given a solution that didn’t 


Example 1.7.6 Determine whether the sequence (a,) given by the rule a, = involve it; you could avoid mentioning l’Hopital’s 
rule in Example 1.7.5 if you used, say, the squeeze 


(-1)” converges or diverges. If it converges, compute the limit. ee nana chatioe ea 


Solution Your first inclination might be to consider the “function” f(x) = 
(-1)*, but you'll run into trouble when trying to tell me the value of f(1/2). 


How does the sequence a, = (—1)" begin? It starts 


so the sequence isn’t getting close to any number in particular. 

Intuitively, the above argument is probably pretty convincing. But if you 
want an airtight argument, you can reason like this: suppose—though we'll 
soon see that this is a ridiculous assumption—that the sequence a, = (-1)" 
did converge to L. Then any subsequence would also converge to L, by 
Theorem 1.6.1 which stated that the limit of a subsequence is the same as the 
limit of the original sequence. If I throw away every other term of the sequence 


(an), I am left with the constant sequence 
=I, sl, =I, =I, =, =I, =), cosy 


which converges to —1, and so L must be —1. 
On the other hand, if I throw away all the terms with odd indices and keep 


only those terms with even indices, I am left with the constant subsequence 


so L must be 1. Since L can’t be both —1 and 1, it couldn’t have been the case 
that lim a, = L for a real number L. In other words, the limit does not exist. 


n—co 
I imagine that the “airtight argument” in the solution 
to Example 1.7.6 is difficult to understand. Please 
don’t worry if you find the argument confusing now— 
we'll have more opportunities for doing these sorts 
of proofs by contradiction in the future. 


Example 1.7.7 Determine whether the sequence a, = (—1/2)" converges or 


diverges. If it converges, compute the limit. 


Solution Let’s use the Squeeze Theorem. Consider the sequences b, = 
—(1/2)" and c, = (1/2)". Then bp < an < cn. And lim c, = O because 


n-co 
lim (1/2)* = 0. Since by = —cy, we have lim b, = — lim cp = -0 = O. 
x—0Oo n—-oo n—-oo 


Since bp and cp converge to zero, the squeeze theorem tells us that lim a, = 0 
as well. a 

If you don’t want to mention the Squeeze Theorem, you could instead 
apply Theorem 1.7.3. In that case, we would again consider the sequence 
Cn = |an| and observe that lim c, = O. But then Theorem 1.7.3 steps in, 
and tells us that lim a, = 0 as well. Of course, a convincing argument for 
why Theorem 1.7.3 works at all goes via the squeeze theorem, so this second 


method is not so different from the first. 


nn 
Example 1.7.8 Determine whether a, = converges or diverges. If it 
n 
converges, compute the limit. 
Solution Since —1 < sinn < 1, we have 
-l — sinn 1 


1 
and can therefore apply the Squeeze Theorem. Since lim Ae = 0, we get 
x— 00 XG 


and so by squeezing, we conclude lim a, = 0. 
n- co 


Example 1.7.9 A particularly common and useful sequence is the geometric 
progression a, = r” for a fixed real number r. For which values of r does this 


sequence converge? 


SEQUENCES 31 


In this problem, you must be very careful to recognize 
the difference between (—1/2)" and -(1/2)". The 
former flip-flops between being positive and being 
negative, while the latter is always negative. 


You might be wondering why I love the Squeeze 
Theorem so much; one reason is that the Squeeze 
Theorem gets you into the idea of “comparing” one 
sequence to another, and this “comparison” idea will 
be big when we get to convergence tests in Chapter 3. 
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Solution It very much does depend on r. 


If r = 1, then a, = (1)" is the constant sequence 


so the sequence converges to one. A similarly boring fate befalls the case r = 0, 
in which case an = (0)" converges to zero. 

If r = —1, we are reprising the sequence which starred in Example 1.7.6; as 
we saw, that sequence diverges. 

If either r > 1 or r < -1, then the terms a, = r” can be made as large as 
one likes by choosing n large enough (and even), so the sequence diverges. 

If O < r< 1, then the sequence converges to 0. 

If —1 < r < O then |r”| = |r|" and O < |r| < 1, so the sequence {[r|"}7°_5 


converges to 0, so also {r"}”’_, converges to 0. 


That last example of a geometric progression is involved enough that it deserves 


to be summarized as a theorem. 


Theorem 1.7.10 The sequence a, = r" converges when —-1 < r < 1, and 
diverges otherwise. In symbols, 


0) if-1<r<1, 
hima ifr=1, and 


does not exist ifr<-—lorr> 1. 


1.8 Qualitative features of sequences 


Sometimes we will not be able to determine the limit of a sequence, but we still 
would like to know whether or not it converges to some unspoken number. In many 
cases, we can determine whether a limit exists, without needing to—or without even 


being able to—compute that limit. 


Your first exposure to mathematics might have been 
about constructions; you might have been asked to 
compute a numeric answer or to propose a solution 
toa problem. But much of mathematics is concerned 
with showing existence, even if the thing that is 
being shown to exist cannot be exhibited itself. 


1.8.1 Monotonicity 


And sometimes we don’t even care about limits, but we’d simply like some terminol- 
ogy with which to describe features we might notice about sequences. Here is some 


of that terminology. 


Definition A sequence is called increasing (or sometimes strictly increasing) 
if dn < An+1 for all n. It is called non-decreasing if ay < an+; for all n. 


Similarly a sequence is decreasing (or, by some people, strictly decreasing) 


if dn > Qn+1 for all n and non-increasing if a, > an+) for all n. 


To make matters worse, the people who insist on saying “strictly increasing” may— 
much to everybody’s confusion—insist on calling a non-decreasing sequence “in- 
creasing.” I’m not going to play their game; Il be careful to say “non-decreasing” 
when I mean a sequence which is getting larger or staying the same. 

To make matters better, lots of facts are true for sequences which are either 
increasing or decreasing; to talk about this situation without constantly saying 


“either increasing or decreasing,” we can make up a single word to cover both cases. 


Definition If a sequence is increasing, non-decreasing, decreasing, or non- 
increasing, it is said to be monotonic. 


Let’s see some examples of sequences which are monotonic. 


n 


Example 1.8.1 The sequence an = which starts 


De 


SEQUENCES 33 


For instance, how much money I have on day n is 
a sequence; I probably hope that sequence is an 
increasing sequence. 
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ap 1 
is increasing. On the other hand, the sequence by = Bae which starts 
n 


is decreasing. 


1.8.2 Boundedness 


Sometimes we can’t say exactly which number a sequence approaches, but we can 


at least say that the sequence doesn’t get too big or too small. 


Definition A sequence (a;,) is bounded above if there is some number M so 
that for all n, we have a; < M. Likewise, a sequence (a,) is bounded below if 
there is some number M so that for every n, we have a, > M. 

If a sequence is both bounded above and bounded below, the sequence is 


said to be bounded. 


If a sequence {an}>_, is increasing or non-decreasing it is bounded below (by ao), 
and if it is decreasing or non-increasing it is bounded above (by apo). 

Finally, with all this new terminology we can state the most important theorem 
of Chapter 1. 


Theorem 1.8.2 If the sequence an is bounded and monotonic, then lim aj 


n-co 
exists. 


In short, bounded monotonic sequences converge—though we can’t necessarily 
describe the number to which they converge. 

We will not prove this theorem in the textbook.° Nevertheless, it is not hard to 
believe: suppose that a sequence is increasing and bounded, so each term is larger 
than the one before, yet never larger than some fixed value M. The terms must then 
get closer and closer to some value between dp and M. It certainly need not be M, 


since M may be a “too generous” upper bound; the limit will be the smallest number 


° Proving this theorem is, honestly, the purview of 
a course in analysis, the theoretical underpinnings 
of calculus. That’s not to say it couldn’t be done in 
this course, but I intend this to be a “first glance” at 
sequences—so much will be left unsaid. 


that is above® all of the terms an. Let’s try an example! 


Example 1.8.3 All of the terms (2'- 1)/2' are less than 2, and the sequence 
is increasing. As we have seen, the limit of the sequence is 1—1 is the smallest 
number that is bigger than all the terms in the sequence. Similarly, all of 
the terms (n+ 1)/n are bigger than 1/2, and the limit is 1—1 is the largest 


number that is smaller than the terms of the sequence. 


We don’t actually need to know that a sequence is monotonic to apply this 
theorem—it is enough to know that the sequence is “eventually” monotonic,’ that is, 
that at some point it becomes increasing or decreasing. For example, the sequence 
10, 9, 8, 15, 3, 21, 4, 3/4, 7/8, 15/16, 31/32,... is not increasing, because among 
the first few terms it is not. But starting with the term 3/4 it is increasing, so if 
the pattern continues and the sequence is bounded, the theorem tells us that the 
“tail” 3/4,7/8, 15/16, 31/32,... converges. Since convergence depends only on 
what happens as n gets large, adding a few terms at the beginning can’t turn a 


convergent sequence into a divergent one. 


| Example 1.8.4 Show that the sequence (an) given by an = n'/" converges. 


Solution We might first show that this sequence is decreasing, that is, we 
show that for all n, 
alee s. (n+ utes 20) 
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° This concept of the “smallest number above all the 
terms” is an incredibly important one; it is the idea of 
a least upper bound that underlies the real numbers. 


’ After all, the limit only depends on what is hap- 
pening after some large index, so throwing away the 
beginning of a sequence won’t affect its convergence 
or its limit. 


You may be worried about my saying that log3 > 1. 
If log were the common (base 10) logarithm, this 
would be wrong, but as far as I’m concerned, there 
is only one log, the natural log. Since 3 > e, we may 
conclude that log3 > 1. 
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But this isn’t true! Take a look 


ars 
V2 ~ 1.4142, 
V3 ~ 1.4422, 
a4 = V4 ~ 1.4142, 
V5 ~ 1.3797, 
V6 ~ 1.3480, 
= V7 ~ 1.3205, 
ag = V8 ~ 1.2968, and 
ag = V9 ~ 1.2765. 


But it does seem that this sequence perhaps is decreasing after the first few 
terms. Can we justify this? 


ily/ 


Yes! Consider the real function f(x) = x°/~ when x = 1. We compute the 


derivative—perhaps via “logarithmic differentiation”—to find 


x= Tos x) 
DD 


f(x) = : 
Note that when x > 3, the derivative f’(x) is negative. Since the function f is 
decreasing, we can conclude that the sequence is decreasing—well, at least for 
n2 3. 
Since all terms of the sequence are positive, the sequence is decreasing and 
bounded when n => 3, and so the sequence converges. 
As it happens, you could compute the limit in Ex- 


ample 1.8.4, but our given solution shows that it 


n! converges even without knowing the limit! 
Example 1.8.5 Show that the sequence a, = — converges. 
n 


Solution Let’s get an idea of what is going on by computing the first few terms. 


1 2 3 
a=, = 2 == 1022290. = — # 0.093750, 

1 eo ag 0D 

Spe = 0.038400 eae = 0.015432 
26s 4 SE, 
720 315 
a7 = ——— ~0.0061199, ag = ——— ~ 0.0024033. 
117649 131072 


The sequence appears to be decreasing. To formally show this, we would need 


to show dn+1 < Gn, but we will instead show that 


An+1 
an 


< Il 


which amounts to the same thing. It is helpful trick here to think of the ratio 


between subsequent terms, since the factorials end up canceling nicely. In 


particular, 

Gnt+1 _ (n+1)! n” 

an (n+1)"*! nl 
Dia!) n” 
= n! (n+1)"+1 
mae Il ia WR im ie 
=m) “(ayy 
mae ll Nine I n+1 


Note that the sequence is bounded below, since every term is positive. 
Because the sequence is decreasing and bounded below, it converges. 


Indeed, Exercise 2 asks you to compute the limit. 


These sorts of arguments involving the ratio of subsequent terms will come up 


again in a big way in Section 3.1. Stay tuned! 
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Exercises for Section 1.8 


(1) 


(2) 


(6) 


Compute lim x!/*. 1m 
x—- 00 


. il 
Use the squeeze theorem to show that lim — =O. Jim 
noo pit 


Determine whether { ¥n + 47 — Wii» converges or diverges. If it converges, compute 
the limit. 1m 


n2 co 
ar ll 
Determine whether jo cae converges or diverges. If it converges, compute the 
=0 


limit. i™/! 
Det heth = econ oe g diverges. If it 2 te th 
etermine whether converges or diverges. If it converges, compute the 
Vn? +3n 
limit. 1™? 
Determine whether {= “} converges or diverges. If it converges, compute the limit. 


> 


2 Series 


We've only just scratched the surface of sequences, and already we've arrived in 
Chapter 2. Series will be the main focus of our attention for the rest of the course. If 
that’s the case, then why did we bother with sequences? Because a series is what 
you get when you add up the terms of a sequence, in order. So we needed to 
talk about sequences to provide the language with which to discuss series. 


Suppose (a,) is a sequence; then the associated series! 


co 
YS) ake = ay + ag + ag + a4 + a5 +++ 
k=] 


I might be thinking that I feel just fine, but I have woken a terrible beast! What 
does that innocuous looking “::-” mean? What does it mean to add up infinitely 
many numbers? It’s not as if I’ll ever be done with all the adding, so how can I ever 
attach a “value” to a series? How can I do infinitely many things, yet live to share 
the answer with you? 

I can't. 

But I can do a large, but finite, number of things, and then see if I’m getting close 


to anything in particular. In other words, I can take a limit. 


2.1 Definition of convergence 


But a limit. .. of what? From a sequence, we can consider the associated series, and 
associated to that series is a yet another sequence—the sequence of partial sums. 


Here’s a formal definition which unwinds this tangled web. 


‘The © symbol may look like an E, but it is the Greek 
letter sigma, and it makes an S sound—just like the 
first letter of the word “series.” If you see “GRUXK,” 
say “grssk.” 
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co 
Definition Suppose (a,) is a sequence with associated series oe ay. The 


k=1 
sequence of partial sums associated to these objects is the sequence 


n 
Sn = » Ak. 
k=1 


Working this out, we have 


S5 = a, + ag + ag +a,+ as, and so on. 


Instead of adding up the infinite sequence aj, which we can’t do, we will instead 


look at the sequence of partial sums, and ask whether that sequence of partial sums 


converges. And if it converges to L, then we'll call L the value of the series. 


co 


Definition Consider the series ay. This series converges if the sequence 
k=1 


me 
of partial sums sp = a, converges. More precisely, if lim s; = L, we then 
noo 


ic—alt 
co 
oS Qk = IL, 
[=I 

co 


and say, “the series y a; converges to L.” 
k=1 
If the sequence of partial sums diverges, we say that the series diverges. 


write 


This might seem overly complicated, but it solves a 
serious problem: we no longer are confronted with 
the supertask of adding up infintely many numbers 
but living to tell the tale. To take the limit of the 
sequence of partial sums is to add up lots—but not 
all!—of the terms in the original sequence to see if 
we're staying close to a particular number—the limit. 
That particular limiting value is then, by definition, 
declared to be the result of adding up all the terms 
in the original sequence in order. 


That the order matters will be a major theme in 
Chapter 4. 


n—-oo 


n 
Remember, infinity is not a number. So if it happens that lim » ay = ~, then 
k=1 


co 


we might write a, = co but nevertheless we still say that the series diverges. 
k=1 


2.2 Geomebric series 


Armed with the official definition of convergence in general, we focus in on the specific 
example: a sequence of the form a, = aor” is called a geometric progression as 
we learned back in Subsection 1.3.2. What happens when we add up the terms ofa 
geometric progression? 


Definition (Geometric Series) A series of the form 


is called a geometric series. 


We can’t simply “add” up the infinitely many terms in the geometric series. What 
we can do, instead, is add up the a first handful of terms. Pick a big value for n, 


and instead compute 


n 
S.= > cou Sco ft agr+agor +aor +:-::+aor. 
k=0 
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Sometimes, to emphasize that the series involves 
adding up infinitely many terms, we will say “infi- 
nite series” instead of just “series.” 


A geometric series was used by Archimedes—who 
lived more than two thousand years ago!—to compute 
the area between a parabola and a straight line. 
Humans had the first inklings of calculus a very long 
time ago. 
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This is the n“ partial sum. Concretely, 


So = Qo, 
S1 = a0 + Gor, 


2. 
S2— Qo Tr Aor 7 aor, 


S3 = a9 + agr+adaor + aor 


Sn = a9 + aor +aor* +agr? +-+++a9r" 

co 
In our quest to assign a value to the infinite series S ao r<, we instead” consider ? Replacing the actual “co” by a limit (that is, a “po- 
=o tential” infinity) shouldn’t seem all that surprising; 

we encountered the same trick in Calculus One. 
n 
a: k 
lim sp = lim aor. 


We can perform some algebraic manipulations on the partial sum. The manipulation 


begins with our multiplying s, by (1 —r) to cause some convenient cancellation, 


specifically, 
Sn(l-r) =ao(1+r r+r r™) (1=r) 
=aj(ltrtrtr r')l-ag(l+r+¢rP4¢r4--tr™l4r")r 
=ao(1+r r+Pr m)-ag(r+rt+rt+- prt ttt) 
Sel Sey ae eat aly Ceiina haat ho 
=agth =r), 
Dividing both sides® by (1 -r) shows * Here, we tacitly assume r # 1. But can you see 
what happens to the geometric series when r = 1 
j—ytrl without going through this argument? 
Sn —— ao .—=<$<—<—<————— 
Li? 
Therefore, 


= tra 
co — lim sp = lim (~:~). 
= n—-oo n-co le 


The limit depends very much on what r is. 

Suppose r > 1 or r< —1. In those cases, lim r"*! does not exist, and likewise 
lim s, does not exist. So the series diverges if r> 1 or if r< —1. One quicker way 
of saying this is that the series diverges when |r| > 1. 

On the other hand, suppose |r| < 1. Then im. ro) = 0, and so 


es peti 


lim sp = lim ag———__ = : 
n—-0o n—0oo lear lear 


Thus, when |r| < 1 the geometric series converges to ag/(1-r). This is important 
enough that well summarize it as a theorem. 


Theorem 2.2.1 Suppose dao # O. Then for a real number r such that |r| < 1, 
the geometric series 


converges to 
-Tr 
For a real number r where |r| = 1, the aforementioned geometric series 
diverges. 


Example 2.2.2 When, for example, ag = 1 and r = 1/2, this means 


This partial sum gets as close to two as you'd like—as long as you are willing 
to choose n large enough. And it doesn’t take long to get close to two! For 
example, even just n = 6, we get 


1 1 1 127 
8 16 32 64 64 
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I which is close to two. 


Example 2.2.3 Consider the series 


1 


This does not quite fit into the preceding framework, because this series starts 
with k = 1 instead of k = 0. 


foe) 
1 
Nevertheless, we can work out what happens. The series Ds a is just 
k=1 


co 


1 

like series DE ae except the former is missing an initial k = O term, which 
k=0 

iswly/, 2° = 1. So each partial sum of the former series is one less than the 


corresponding partial sum for the latter series, so the limit is also one less i 


Figure 2.1: Visual evidence that » 


than the value of the geometric series. In symbols, Ga bo Bega 
n=1 
il 
ee) 1 co l l with a — x 1 rectangle, and build each subsequent 
al — Ss alba — tT cae rectangle by cloning and halving the previous rectan- 
n=1 2 n=0 2 = 2) gle; all these rectangles fit together to fill up a unit 


square. 


If you don’t find this argument convincing, look at Figure 2.1, which displays 


a visual argument that the series » BE converges to one. 
k=1 


2.3. Properties of series 
Theorem 1.7.1 presented many properties of sequences. Since the value of a series 


is the limit of the sequence of partial sums, properties of limits can be reformulated 


into properties of series. 


2.3.1 Constant multiple 


co 


Theorem 2.3.1 Suppose Se ay is a convergent series, and c is a constant. 


k=0 


co 
Then Ss Cd, converges, and 
k=0 


Proof If you know just enough algebra to be dangerous, you may remember 
that for any real numbers a, b, and c, 


c(a+b)=ca-+cb. 


This is the distributive law for real numbers. By using the distributive law 
more than once, 


c(dp + a) + a2) = cag +ca; + cap, 


or more generally, for some finite n, 


c(ao9 + ai + a2 +--+: + an) = cag +ca, +can+::-+can. 


So what’s the big deal with proving Theorem ? Can’t we just scream “distributive 
law!” and be done with it? After all, Theorem amounts to 


©Go mt CGI CGy 4 CGn ae = C(Gp a Cy. 1Go Gy 


But hold your horses: you can only apply the distributive law finitely many 
times! The distributive law, without some input from calculus, will not succeed 
in justifying Theorem . 

Let’s see how to handle this formally. By hypothesis, Ds a; is a convergent 


k=0 
series, meaning its associated sequence of partial sums, 


n 
Sn = os ak, 
k=0 
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converges. In other words, lim sp exists. Then, by Theorem , 


n—-oo 


lim (cs,) =c lim spy. 
n—-oo n-oo 
co 
But c Sy is the sequence of partial sums for the series y C Ax, because 
k=0 


CSa = CCH =F CG =— CEB =F ooo ar CGE 


Consequently, 


» cae = lim (csp) =c lim sp, 


n-o n-oo 


which is what we wanted to prove. 


That theorem addresses the case of multiplying a convergent series by a constant 


c; what about divergence? 


Example 2.3.2 Suppose that a; diverges; does OS ca, also diverge? 
k=0 k=0 


co co 
Solution If c = 0, then oy Cay = Py O which does converge, to zero. 
k=0 k=0 


On the other hand, provided c # O, then, yes, » ca, also diverges. How 
k=0 
do we know? 
We are working under the hypothesis that Ss a; diverges. Suppose now, to 
k=0 


the contrary, that SS ca, did converge; applying Theorem 2.3.1 (albeit with 
k=0 
ay replaced by ca, and c replaced by (1/c)), the series 


> (2) 


k=0 


converges, but that is ridiculous, since 
oO 1 foe) 
—-|ca,= q 
Dalle 28: 
and the latter, under our hypothesis, diverged. A series cannot both converge 
co 


and diverge, so our assumption (that 3 ca, did converge) must have been 
k=0 
co 
mistaken—it must be that ca, diverges. 
k=0 


But what about the case where c = 0? In that case, the series converged! Did we 


make a mistake? In the argument for divergence, we multiplied by 1/c, which is 


something we are not permitted to do when c = 0. 


In light of this example, we have actually proved something stronger. 


co 
Theorem 2.3.3 Consider the series De ay, and suppose c is a nonzero con- 
k=0 
co co 
stant. Then Ss a, and oS ca, share a common fate: either both series 
he k=0 
converge, or both series diverge. 
co 
Moreover, when Ay converges, 
k=0 
co co 
CaAa~ =C: Ak 
k=0 k=0 


2.3.2 Sum of series 


co co co 
Suppose a, and Ss by are convergent series. What can be said of (aie + be)? 
k=0 k=0 k=0 
Addition is associative* and commutative’, so for any real numbers a, b, c, 
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We can connect this discussion back to the dis- 
cussion of geometric series in Section 2.2. If you 


7 1 
believe that ) — es then by Theorem 2.3.3, 
=1F 
k=0 


= c 
you believe ) Cr = ee which is part of Theo- 
-r 


k=0 
rem. aly 


* To say that addition is “associative” is, intuitively, to 
say that how the expression is parenthesized doesn’t 
matter; formally, “associativity” means that for any 
a, b, and c, we havea+(b+c) =(a+b)+c. 

° To say that addition is “commutative” is, intuitively, 
to say that the order in which the adding is done 
doesn’t matter; formally, “commutativity” means that 
for a and b. we havea+b=b-a. 
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and d, 
(a+ b)+(c+d) =(a+c)+(b+d). 
More generally, for real numbers do, aj, do, ..., An and real numbers bo, bj, bo, 
59 ne 
(aq Qi do << Gn) (Dos bi 4 bo 4: "te P) — (Got 9) (att Bi) (aa bs) = (aad On) 


But this finite statement can be beefed up into a statement about series. What we 


want to prove is 
co co [e.e} 


Dee Le YS) (ake + Bx) - 


k=0 k=0 k=0 


From above, we already know 


Say be = -y (an + be) - 
k=0 k=0 


Take the limit of both sides. 
n n n 
tim >) at ), | = ee Dee 
k=0 k=0 k=0 
But the limit of a sum is the sum of the limits®, so 


n n n 
im, 35 a+ (1m, 9° be] = tim, 9 (au +) 


k=0 k=0 


Those three limits of partial sums can each be replaced by the series, which shows 


ey be = y (an + be) - 
k=0 k=0 k=0 


This can be summarized in a theorem. 


°] like to call this a chiastic rule, since it has the 
rhetorical pattern of a chiasmus. 


Theorem 2.3.4 Suppose ay and » bye are convergent series. Then 
k=0 k=0 


co 


SS (ax + be) is convergent, and 
k=0 


Dy (aie + Pr) = iD ax}+{3) bx) 


That covers sums of convergent series. 


Example 2.3.5 Now suppose that Dy ay and » by diverge; does SS (ak + bx) 
= k=0 


k=0 _ k=0 
diverge? 


Solution Not necessarily. Let a, = 1 and bk = —1, so a, and > br 
k=0 k=0 


diverge. But 


co co co 


>, (ae + be) = D1 (1) + (-1)) = D0 =0. 


k=0 k=0 k=0 
This is not to say that the term-by-term sum of divergent series necessarily 


converges, either. It is entirely possible that oS (ax + by) will also diverge. For 


k=0 
istance, if a, = bk = 1, then 
Y) (ak + be) = D1(1+1) = )'2 
k=0 k=0 k=0 


also diverges. So the term-by-term sum of divergent series might converge or 


might diverge, depending on the situation. 
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2.4 Telescoping series 


For most of this course, we will be happy if we can show that a series converges or 
that a series diverges; we will not, usually, be too concerned with finding the value 
of a series. Why not? Usually it is just too hard to determine the value; we would if 
we could, but since it is often too hard, we don’t bother. 

Nevertheless, there is one family of series for which we can calculate the value 
with relative ease: the telescoping series. Here is a first example which suggests 


what we mean by “telescoping.” 


n 


1 
Example 2.4.1 Compute ——_-. 
: 24 ee FI) 
= 
i You might know about a method called partial frac- 
Solution Note that 1 1 
as to rewrite een as a combination of k 
1 tear ll k 1 
k kK+1 k-(k+1) k-(k+1) ai 
ear il—ie 1 
k-(k+1) k-(k+1) 
Consequently, 
Y 1 =(2 1 late 1 )+(2 1 lee HC 1 ) 
Qk(k+1) \1 141/ \2 241) \3 341 n n+l 
=< +( 1 +5) +( 1 ts) 1 wi 1 
Tee aN sy Gaye ay) ei 
A 1 
“1 ntl 


since most of these terms end up canceling. 


In general, we say that a series telescopes if, after some simplification, there 
is a formula for the sequence of partial sums with a fixed number of terms. The 
name suggests the way the cancellation happens: just as the nesting rings in an 
expandable spyglass fit together, so too do the neighboring terms in a telescoping 


series fit together and collapse. 


Armed with a formula for the sequence of partial sums, we can attack the 


corresponding infinite series. 


co 


Example 2.4.2 Compute DS 
k=1 


1 
k-(k+1) 
Solution We just computed that 


ws 1 1 
OS eee, il 
See) n+ 


Rewriting the infinite series as the limit of the sequence of partial sums yields 


ica k— 
= lim (1- 
n—-co n+1 
1 
= lim 1- lim 
n—0oo noo n+] 
=1-0O0=1 


So the value of this series is 1. 


2.5 A test for divergence 


Usually, the sequence of partial sums sp, = do + a; +-:: + Gp is harder to under- 
stand and analyze than the sequence of terms a,. It would be helpful if we could say 
something about the complicated sequence s, by studying the easier-to-understand 
sequence ak. 

Specifically, if the sequence s, converges, what can be said about the sequence 
ay? If adding up more and more terms from the sequence a, gets closer and closer 
to some number, then the size of the terms of a, had better be getting very small. 


Let’s make this precise. 


SERIES 51 


52 SEQUENCES AND SERIES 


Theorem 2.5.1 If ) a, converges then lim an = 0. 


noo 
k=0 


Proof Intuitively, this should seem reasonable: after all, if the terms in the 


sequence a, were getting very large (that is, not converging to zero), then adding 
co 


up those very large numbers would prevent the series a; from converging. 
k=0 


co 

We can put this intuitive thinking on a firm foundation. Say Ay Con- 
k=0 

verges to L, meaning lim sp = L. But then also lim sp_; = L, because that 


n—-oco n—-oo 
sequence amounts to saying the same thing, but with the terms renumbered. By 
Theorem ??, 
lim (Sp — Sp-1) = lim sp—- lim sp_-) = L-L =O. 


n-co n—-oo n-co 


Replacing sp with ap + -:: + an, we get 


cS 
8 
Q 
= 
| 
8 
& 
g 
is) 
=] 
iw 
I 
? 


Sn — Sn-1 = (ao 


and therefore, lim an = O. 
n—-co 


The contrapositive of Theorem 2.5.1 can be used as a divergence test. 


Theorem 2.5.2 Consider the series ay. If the limit lim ap does not exist 
n-co 
k=0 
or has a value other than zero, then the series diverges. 


We'll usually call this theorem the “n™ term test.” 


Warning The converse of Theorem 2.5.1 is not true: even if lim a, = O, the 
n-oo 
series could diverge. 


This is a very common mistake: you might be tempted to show that a series 
converges by showing lim an = O, but that doesn’t work. The n™ term test 
either says “diverges!” or says nothing at all. It is not possible to show that 
anything converges by using the n™ term test. 


For an example, see Section 2.6. 


One analogy that can be helpful is think about weather: whenever it is raining, it 


is cloudy. Yet it is possible for there to be clouds, even on a rainless day. 3 


Co 
Likewise, whenever the series ) a, converges (“it is raining”), the sequence 


k=0 
ay converges to zero (“it is cloudy”). If it isn’t cloudy, then we can be sure it isn’t 


raining—and this is the statement of Theorem 2.5.2. Let’s use this “divergence test” 


to show that a particular series diverges. 


~ n 
Example 2.5.3 Show that — diverges. 
p Dy q Mivers 


Solution We apply the n™ term test: all we need to do is to compute the limit 


Since the limit exists but is not zero (i.e., “it is not cloudy”), the series must 
diverge (“it can’t be raining.”). 
Looking at the first few terms perhaps makes it clear that the series has no 
chance of converging: 
Dee oe 
2 8 a & 
will just get larger and larger; indeed, after a bit longer the series starts to 


look very much like---+ 1+1-+1+1+---, and if we add up many numbers 


which are very close to one, then we can make the sum as large as we desire. 
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2.6 Harmonic series 


co 


The series ) — has a special name. 
n 


t= 
Definition The series 
7 ee ee 
od oe a 
ml 
is called the harmonic series. 


The main question for this section—indeed, the question which should always be 


our first question anytime we see an unknown series—is the following question: 


Does the harmonic series converge. . . or diverge? 


How can we begin to explore this question? 


2.6.1 The limit of the terms 


In general, the easiest way to prove that a series diverges is to apply the n term 
test from Theorem 2.5.2. What does the n“ term test tell us for the harmonic series? 
We calculate 


’ 1 
lim — = 0, 
n-o nN 


so the n" term test is silent; since the limit of the terms of the series exists and is 
equal to zero, the n™ term test does not tell us any information. 

The harmonic series passed the first gauntlet—but that does not mean the 
harmonic series will survive the whole game. All we know is that the harmonic does 
doesn’t diverge for the most obvious reason, but whether it diverges or converges is 


yet to be determined. 


2.6.2 Numerical evidence 


If you have the fortitude® to add up the first hundred terms, you will find that 


When confronted with the question of whether a 
series diverges or converges, the first thing to check 
is the limit of the terms—if that limit doesn’t exist, 
or does exist but equals a number other than zero, 
then the series diverges. 


® lacking fortitude, software will suffice 


yee me 
hel ae " 100 
nT 


_ 14466636279520351160221518043104131447711 


25.19. 


~ 278881500918849908658 13523574 12492142272 
If we add up the first thousand terms, we will find that 


pee 
T 
att 1 2 


If we add up the first ten thousand terms, we will find that 


10000 


1000 


1 


10000 


= 7.49. 


= 9.79 


The partial sums are getting bigger, but not very quickly. Maybe the series converges. 


Maybe it converges to... about ten? 


2.6.3 An analytic argument 


That numeric evidence might have made us think otherwise, but the harmonic 


series diverges. 


But in fact the partial sums do get arbitrarily large; they just get big very, very 


slowly. Consider the following: 


1 1 1 1 1 1 1 1 
1 Sal 1 
2253 ee 2 4" 4 2a, 
1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 
Jose etatetspats peta b ape betes ait stata 
De” Bs aE i HE Oh A a BSP) 22 ee 
1 1 1 1 1 1 1 1 1 1 
bi +=4 =a -titote-4 1 
oy 8} 16 2 4 4 8 8 16 16 


and so on. By swallowing up more and more terms we can always manage to add 


at least another 1/2 to the sum, and by adding enough of these we can make the 


partial sums as big as we like. In fact, it’s not hard to see from this pattern that 


1 
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so to make sure the sum is over 100, for example, we’d add up terms until we get to 
around 1/ ges that is, about 4- 10°9 terms. 


2.7 Comparison test 


A bounded, monotonic sequence necessarily converges (Theorem 1.8.2). How does 
this fact about sequences relate to series? When is the sequence of partial sums 
monotonic? If the terms of a series are non-negative, then the associated sequence 


of partial sums is non-decreasing. 


co 


Corollary 2.7.1 Consider the series SS a,x. Assume the terms a, are non- 
k=0 
negative. If the sequence of partial sums Sy; = dp + -:: + Gn is bounded, then 


the series converges. 


So we can show that a series of positive terms converges, provided we can bound 


the sequence of partial sums. 


2.7.1 Statement of the Comparison Test 


But how can we manage to do that? One way to ensure that the sequence of partial 


sums is bounded is by comparing the series to another series. Consider two series 


. Ak and S bie 
k=0 k=0 


Suppose, for all k, that b, > a, => 0. Then 


OB ae Gh) sree Gin Tepe ta) gene ae 


Suppose that oy by converges to L. Then 
k=0 


Agta, +---+a,<bo+b,+---+b, < L, 


so the sequence of partial sums s; = a9 + a} +-::+dnis bounded. But we just won 
n 


the game: each term a; is nonnegative, so the sequence of partial sums s,;, = yy Ak 
k=0 
is increasing. Theorem 1.8.2 guarantees that the sequence (s,,) converges. 
Let’s summarize what just happened: if a series with positive terms is, termwise, 
less than a convergent series, it converges. We have just proved half of the following 


theorem. 


Theorem 2.7.2 Suppose that ay, and by are non-negative for all n and that, 


for some N, whenever n > N, we have ap < bp. 


co co 
If Ss b, converges, so does oS (Ger 
n=0 n=0 


If > an diverges, so does oS Dee 
n=0 n=0 


This is usually called the Comparison Test; we might summarize it like this: 


e A non-negative series, overestimated by a convergent series, converges. 


e Anon-negative series, underestimated by a divergent series, diverges. 


Warning Being less than a divergent series does not help: the comparison test 


is silent in that case. 
Similarly, being larger than a convergent series does not help. The Compari- 
son Test only says something when a series (with non-negative terms!) is less 


than a convergent series, or greater than a divergent series. 


2.7.2 Applications of the Comparison Test 


Like the n™ term test (Theorem 2.5.2), we can use the Comparison Test (Theo- 


rem 2.7.2) to show that a series diverges. 
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logn 


Example 2.7.3 Does the series » converge? 


i 


Solution Our first inclination might be to apply the n“ term test, but in this 


case, 
. logn 
lim —a()h 
n—-0co n 


so the n" term test is silent in this case. As far as we know at this point, the 


series may diverge or converge. 


logn 
g . Note 


1 
Instead, we’ll try the Comparison Test. Set a, = — and by, = 
n 
that whenever n > 3, we have 


OS @a S lon, 


co 


but the series — diverges, and so by the Comparison Test, the given series 
n 
n=3 
(which is even bigger!) must likewise diverge. 


Recall that the n term test cannot be used to prove that a series converges; if 
the n'” term test does not answer “diverges!” then the test is silent. In wonderful 


contrast, the Comparison Test can be used to show that a series converges. 


2 


: — sin2n 5 
Example 2.7.4 Does the series SS on converge‘? 
n=1 
Solution Yes. Set 
sin? n 
i a euntel 2) = 
co 
Note that O < a, < by. But the series oe bn converges, since it is a geometric 
i 
series with common ratio 1/2, as in Example 2.2.2. Therefore, the series 


co 


y An converges by the comparison test. 


n=1 


2.7.3. Cauchy Condensation Test 


Remember in Section 2.6 when we considered the harmonic series? We showed 
co 


1 
that it diverged by comparing it with the divergent series » 5° but we couldn’t 
n=1 
make that comparison right away—first we had to group together the terms in a 


somewhat complicated seeming way. 
We can generalize that “grouping together” trick; this is called the Cauchy 


Condensation Test. 


Theorem 2.7.5 a (a) is a non-increasing Sedu GCS of positive num- 


bers. The series . an converges if and only if the series SS (2™aon) converges. 
n=1 n=0 


co 


The series » (2™aon) is often called the condensed series associated to the 
n=0 


co 
series ) An 
n=1 


Proof Let’s suppose that os (2™agn) converges; the goal then is to show that 
n=0 


An also converges. 
n=1 
Since the sequence (an) is decreasing, we have that 
az + ag < ag + ag 
a4 + O5 + Ag + a7 S$ 4 + 4 + 4 + 4 
ag +---+aj5 < 8ag 


Agn +--++ Apnt1_] S 2” aon. 
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If you have already seen some convergence tests 
before—perhaps you have already been through Cal- 
culus Two!—you might be wondering why “conden- 
sation” is making an appearance. It is perhaps less 
popular than other tests, but I like it. Pedagogically, 
it is nice to see that the “trick” in the harmonic series 
can be generalized and applied to lots of other series. 
In particular, condensation permits the study of p- 
series without going through the usual route of the 
Integral Test. 
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Therefore, 
Dis k-1 
ye An < Sy 2” aon. 
n=1 n=0 


As a result, the sequence of partial sums s~, = os An is bounded above by 


n=1 
co 


y 2” apn. Moreover, the sequence of partial sums (s;.) is increasing. Therefore, 
n=0 


by the Monotone Convergence Theorem, the series (sx) converges. 
co 


On the other hand, suppose that os An converges; let’s show that (2”agn) 


n=1 n=0 
co 


also converges. Once we have done so, we will have shown that a An converges 


n=1 


if and only if a (2™agn) converges. 
n=0 
Since the sequence (an) is decreasing, we have that 


ai +ag<a,t+aq, 


dg +3a4 <d2+a,+a3+ag3 


a4 +7ag<a,+a,+a5+a5+ Ag+ ag + a7 + a7 
ag + 15.ajg < 2(ag +---+ a5) 


gn + (ers — 1) Ggnt < 2(agn +--+ + Gynti_). 


k 
So the sequence of partial sums for the series Se (2™apn) are bounded above by 
n=0 


co 


2- De An. Moreover, that sequence of partial sums is increasing, and therefore, 


n=1 
co 


by the Monotone Convergence Theorem, the series y (2™ apn) converges—which 
n=0 


is what we wanted to show. 


What we’ve shown is a bit stronger than simply that the original series and the 
condensed series share the same fate—converging or diverging together. In fact, we 
have an estimate on the value of the original series, in terms of the value of the 


condensed series. We have shown that 


2.7.4 Examples of condensation 


co 


1 
Example 2.7.6 Does the series Sy =z converge? 
n=1 fs 


CO 
This is not a geometric series: we already know that D a converges, but this 


n=1 
=i i 
is asking about something very different, namely De =a 
—n 


n=1 
Solution To get some intuition for what is going on, let’s do some numerical 


calculations. 
Sela eet el eli eel 
De To aes GAY 
n=1 
1968329 
= ——  & Iie, 
1270080 


or going out a bit farther, 


yo Beene eaco snd 

Zig 12" 002 
Soe! pee aaG 
n2 12° Toe. om 


SERIES 61 


62 SEQUENCES AND SERIES 


From this numerical evidence, it certainly looks like this series converges. And 
indeed, it does—quite surprisingly, 
. 1 ue 
=) = ——. 
ast 6 
This is the so-called Basel problem. 


We do not yet have the tools necessarily to show that the value of the series 


is 1 /6, but do we have the tools needed to show that the series converges. 
re 


fee) 
By condensation, it suffices to show that converges. But 
n=1 


an)? 


and since the “condensed” series converges, so too must the original series 


converge. 


Example 2.7.7 Does sy 
n=2 


| sin n| 5 
=) converge? 


Solution We can’t apply Cauchy condensation here, because the terms of this 


series are not decreasing. But we can apply the Comparison Test. Moments 


co 
1 
ago, we saw that S —z converges, and 
n=1 di 
| sin n| . 1 
me 


because |sin n| < 1. The partial sums are non-decreasing and bounded above 


co 
by oy 1/n” = L, so the series converges. 
n=1 
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2.7.5 Convergence of p-series 


co 


Let us consider the series SS an Such a series is called a p-series. Does a p-series 
n 


n=1 
converge? Diverge? It depends on p. If we think of this as a function of p, then we have 
the Riemann zeta function, that is, 
co fos) 
1 1 
Example 2.7.8 Let p< 1. Does the series S as converge? (p) = S aa 
7 n=1 
n=1 


The Riemann zeta function is quite important: it 
Solution When p = 1, this series is the harmonic series we already proved to plays a key role in number theory via the Riemann 
hypothesis and also has applications in physics. 
Something that connects the physical world to num- 
ber theory must be pretty incredible. 


diverge in Section 2.6. 


1 
But more generally, the series ne eo diverges whenever p < 1. We will 
Tv 
n=1 
show this by comparing to a harmonic series. Since p < 1, then n” < n, and so 


1 1 
— = = 
nmPon 
i 
But the harmonic series Ds — diverges, and so by comparison, the series 
—n 
Fe , n=1 
SS — diverges. 
nP 
n=1 
co 
1 
Example 2.7.9 Let p> 1. Does the series Se = converge? 
n 
n=1 


Solution It converges. For this, we use Cauchy condensation: consider the 


~ 1 
Q”". : 
du (Bee 


“condensed” series 


But this series simplifies to 


eee op ee 
2 ap = Lamy 


n=1 
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]_ which converges. 


Exercises for Section 2.7 


(1) Explain wh ys ees diverges. {lll 
Xp. Ly a Qn2 dei : 

(2) Explain wh Ys asia diverges. lll 
i : n=1 PEE es , 


=) 5 
(3) Explain why > — diverges. lim 
n=1 ut 


4 3 
(4) Compute TE >> 
Dy (Sr 8 


3) 4 
(5) Compute » —+—. I.» 
0 


(6) Compute 


co 


3nrl 


(7) Compute 33 wae 


n=0 


oe) 


> 


(8) Compute » (2). (>> 


n=1 


oy n 


3 
(9) Compute » ot 


n=1 


> 
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3 Convergence tests 


It is generally quite difficult—indeed, often impossible—to determine the value of a 
series exactly. Even if we can’t compute the value of a series, in many cases it is 
possible to determine whether or not the series converges. We will spend most of 


our time on this problem. 


3.1 Ratio tests 


SB 
n 
Does the series yy 5a converge? It is possible, but a bit unpleasant, to approach 
n=0 
this with the comparison test. 


2 
n 
Example 3.1.1 The series ) — converges. 
Bn 
n=0 


Solution As long as n > 23, we have 2" > n°. Therefore, as long as n > 23, 
we have 
ee Eee 
BE 
Bye Bye 


n 
But the geometric series (=) converges, since the ratio between subse- 


n=23 
quent terms is less than one. So by comparison, the smaller series 


Mathematics is more than just about getting an- 
swers; a goal of mathematics is not only to find 
truth, but to package the resulting “truth” in a for- 
mat that permits another human being to under- 
stand the reasons for its being true. Arguments like 
this—which are perfectly convincing but seem en- 
tirely unmotivated—are, arguably, missing the point. 
What has been gained if we find something is true but 
the reason for its being true remains inscrutable? 
This idea—that the first handful of terms do not 
affect convergence at all—will be discussed formally 
in Section 5.1. 
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must also converge. The first handful of terms when n < 23 doesn’t affect 


convergence at all, so we are justified to conclude that the original series 
oS — converges. 
Bn 


n=0 


That worked—but it invoked an unmotivated fact: how do I know that 2” > n> 


whenever n > 23? Invoking that fact seems a bit random—yes, yes, a proof, but 
perhaps not a proof that conveys exactly what is going on. It is a valid argument, 


but missing some motivation. 


3.1.1 Theory 


Instead, consider what happens as we move from one term to the next term in this 

series, that is, consider two neighboring terms 
5 5 

Dae (n+ 1) 


Bn 5ntrl 


The denominator goes up by a factor of 5, 5"t! — 5.5", but the numerator goes up 


by much less: (n+ 1)? = n° +5n* + 10n® + 10n? + 5n+ 1, which is much less 


than 5n° when n is large, because 5n* is much less than n°. (This sort of thinking 


is why it was worth comparing n° to an exponential 2” for n large.) 
So we might guess that in the long run—when n is very large—it begins to look as 
if each term is about 1/5 of the previous term. We have seen series that behave 


like this, namely the geometric series 
ss eee 
feel 


We are beginning to see why it made sense to compare the given series to a geometric 
series as in the initially very unmotivated argument above. 

But we can do better! Instead of an ad hoc argument which compared te lowe 
we can try to make rigorous the idea that each term is “eventually” about a fifth as 


big as the previous term. The key is to notice that 


Viet iy aoa ak! 
Teg eee ee ions ae 


nc Ay noc = 5ntl 75d n—-co n° 5 5 5" 


This is a more formal version of what we noticed about the ratio of subsequent 


terms: in the long run, each term is one fifth of the previous term. Pick some 


1 1 
number just slightly bigger than 5 let’s call that number 5 +. 


Because 


. An+1 1 
| ee : 
nc Ay 5 


a, 
then by choosing n big enough, say n > N for some N, we can guarantee that places 
an 
1 1 
is as close as we'd like to 5 say within ¢ of 5 More succinctly, there must be some 
N so that whenever n > N, we have 
An+1 
an 


2 ar 
Aga E 
5 
Multiplying both sides by an, we find whenever n => N that 
1 
An+1 < (= ar 2) Aan. 
We can say the same thing when n is replaced by N + 1, meaning 
1 
an+2 < (= ap 2) aN+1; 
which together with the previous statement when nis N implies 
1 2 
an+2 < (= ar 2) an. 
And we can repeat this again! Since 


1 
an+3 < (= te 2) an+2> 
we also learn that 3 
an+3 < (= ot 2) an, 
or in general, 
1 k 
AN+k < (= ar 2) an. 
This is setting up a comparison. The geometric series 


Dery =(2(5 +4] 


k=0 k=0 
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The symbol ¢ is the Greek letter epsilon, and, con- 
ventionally, denotes a small but positive number. 
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1 
converges as long as ¢ had been chosen so small that 5 +eée< 1. Butif that series 


converges, then the series 


co 
)) antk = an + A@n+1 + An+2+°:- 
k=0 


also converges, because each term of that series is smaller than the corresponding 


term of the convergent geometric series. But if that series converges, then 
fee) 
Sak = a9 + a + a9 + 
k=0 


converges since we’ve just added the number ap + a; + --- + ay-, to the convergent 
co 


series yy AN+k- 
k=0 
Under what circumstances could we do this? What was crucial was that the limit 


of Gn+1/ An, say L, was less than 1 so that we could pick a value eso that L+e< 1 


and then compare to the convergent series 


co 


» (L+)*- aw. 

k=0 
That’s really all that is required to make the argument work. We also made use of 
the fact that the terms of the series were positive. Let’s summarize the situation 


when this works. 


Theorem 3.1.2 (The Ratio Test) Consider the series Ss An where each term 
n—O 
An is positive. Suppose that 


P An+1 
ifien 


n-oco An 


=L. 


If L < 1 the series Ds an converges. If L> 1 the series diverges. If L = 1 this 


n=0 
test is inconclusive. 


In general, we can consider instead the absolute 
values of the terms, and end up testing for absolute 
convergence. We'll discuss this topic in Section 4.1. 


Proof Example 3.1.1 essentially proves the first part of this, if we simply replace 
1/5 by L and 1/2 by r. So when L < 1, the series converges. 

Let’s consider the other situation. Suppose that L > 1, and pick r so that 
1<r<L. Then forn= N, for some N, 


|an+1| 
lanl 


>r and |dan+i| > rlanl. 


This implies that |ay+| > r lay, but since r > 1 this means that jim lan+x«l # 0, 
— 00 


which means also that lim a, # 0. By the divergence test, the series diverges. 


n—-oo 


Finally, when L = 1, the test truly is inconclusive—not because we aren’t 
clever enough, but because there are both convergent and divergent series with 


co 


L=1. For example, the p-series ys Wie converges, and the harmonic series 


n=1 


co 


S 1/n diverges—but in both cases, L = 1. 


n=1 


3.1.2 Practice 


The ratio test is particularly useful for series involving the factorial function. 


Example 3.1.3 Does the series 


y 5" /n! 
n=0 


converge or diverge? 
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“It works in practice—but does it work in theory?” 
The ratio test is awfully useful in practice, but I 
think the theory behind it—that we’re taking a limit 
of the ratio between neighboring terms in order to 
compare with a geometric series—is quite lovely. 


Remember our convention that 0! = 1. Despite 
appearances, we are not dividing by zero. 
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[oe] 
Solution Let’s name the terms a, = 5"/n! so we are considering ae An. To 
n=0 
apply the ratio test, we consider 


5mtl on! 


N20 Ay noo (n+ 1)! Br 


n! 


Since O < 1, the series converges by the ratio test. 


Exercises for Section 3.1 


co 
1 
(1) Compute lim |aj+1/ap| for the series DE =: COIN 
= 
co 
P 1 
(2) Compute lim |an+1/an| for the series » =. > 
n-o 1 n 
= 


Determine whether each of the following series converges or diverges. 


8 


ao 
(3) ey a 11> 
all 
(4) YS Mm 4 
n=1 
es 
(5) = Mm 4 
iT 


ee 1 
(6) » ey > 
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3.2 Integral test 


If all of the terms a, in a series are non-negative, then clearly the sequence of partial 
sums Sp is non-decreasing. This means that if we can show that the sequence 
of partial sums is bounded, the series must converge. We know that if the series 
converges, the terms a, approach zero, but this does not mean that a, > an+) for 
every n. Many useful and interesting series do have this property, however, and 


they are among the easiest to understand. Let’s look at an example. 


3.2.1 An example 


— 1 
Example 3.2.1 Show that =z converges. 
n=1 iM 


Solution We have actually already seen this very series—it appeared in Exam- 
ple 2.7.6, where we attacked this series via condensation. Here, we consider a 
different approach, namely integration. 


The terms 1/n? are positive and decreasing, and since lim 1/ x? = 0, the 
xX co 


terms 1/n? approach zero. We seek an upper bound for all the partial sums, 
that is, we want to find a number N so that s, < N for every n. The upper 
bound is provided courtesy of integration. 

Figure 3.1 shows the graph of y = 1/ x together with some rectangles that 
lie completely below the curve and that all have base length one. Because the 
heights of the rectangles are determined by the height of the curve, the areas 
of the rectangles are 1/ 17, 1/27, 1/37, and so on—in other words, exactly the 
terms of the series. The partial sum s, is simply the sum of the areas of the 
first n rectangles. Because the rectangles all lie between the curve and the 
x-axis, any sum of rectangle areas is less than the corresponding area under 
the curve, and so of course any sum of rectangle areas is less than the area 
under the entire curve, that is, all the way to infinity. There is a bit of trouble 


at the left end, where there is an asymptote, but we can work around that 


>xandn 


1 2 3 4 5 


Figure 3.1: Plot of f(x) = 1/x* alongside boxes 
representing an = 1/n?. 


easily. Here it is: 


= Ae DN _ 1 \ =i \ ~ i = = 
Sn Fo 53) Pao eo oa ‘ ees Lar 2, 


recalling how to compute this improper integral. Since the sequence of partial 
sums Ss, is increasing and bounded above by 2, we know that lim sp = L< 2, 
n—-oo 


and so the series converges to some number less than 2. 


— 1 
In fact, it is possible, though difficult, to show that » = 1/6. 
n 
n=1 


3.2.2 Harmonic series 


We already know that > 1/n diverges. What goes wrong if we try to apply this 
technique to it? We find 


Eee pacit fo laxcit ae 
Ss ry wee —_ 
n 1 T 2 T 3 T T n T i x x 
but this amounts to saying nothing, because the improper integral — dx does 
x 


not converge, and claiming that s, is bounded by something divergent is to make 
no claim at all: every real number is less than infinity! In other words, this does not 
prove that yy 1/n diverges; it is just that this particular calculation fails to prove 
that it converges. A slight modification, however, allows us to prove in a second way 
that » 1/n diverges. 


Example 3.2.2 Consider a slightly altered version of Figure 3.1, shown in 
Figure 3.2. Explain how to use the figure to see that the harmonic series 


diverges. 


Solution The rectangles this time are above the curve, that is, each rectangle 


completely contains the corresponding area under the curve. This means that 


i i. il 1 ak Fl n+l 
maptgtyte tse ga =In(n+ 1). 


CONVERGENCE TESTS 75 


1 2 3 4 5 6 


Figure 3.2: Plot of f(x) = 1/x alongside boxes 
representing a, = 1/n. 
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As n gets bigger, In(n + 1) goes to infinity, so the sequence of partial sums sp 


must also go to infinity, so the harmonic series diverges. 


3.2.3 Statement of integral test 


The important fact that clinches this example is that 
imap 
lim = (he = 65, 


N00 Jy x 


i x 
dx 4 
1 


So these two examples taken together indicate that we can prove that a series 


which we can rewrite as 


converges or prove that it diverges with a single calculation of an improper integral. 


This is known as the integral test, which we state as a theorem. 


Theorem 3.2.3 (Integral test) Suppose that f(x) > 0 and is decreasing on 
the infinite interval |k, co) (for some k > 1) and that a, = f(n). Then the series 


S an converges if and only if the improper integral ih f(x) dx converges. 
n=k k 


3.2.4 p-series 
The two examples we have seen are examples of p-series, which we first encountered 


in Subsection 2.7.5. Recall that a p-series is any series of the form 1/n?. 


n=1 


Theorem 3.2.4 A p-series converges if and only if p > 1. 


We already proved this theorem using condensation in Example 2.7.8 and 


Example 2.7.9. Nevertheless, we provide a second proof, using the integral test. 


Proof We use the integral test; the case p = 1 is that of the harmonic series, 
which we know diverges, so without loss of generality, we may assume that 
p#1.Ifp<o0, lim 1/n? #0, so the series diverges by Theorem 2.5.2. So we 
may also assume that jo =O, 


Then we compute 


coy solar | N}-P 1 
{ dx = lim = lim - 
l il N>ol—p 1-p 


Ifp > 1thenl-p<0O and lim N}P = 0, so the integral converges. If0 < p< 1 


then 1—p>Oand lim N'? = 0, so the integral diverges. 


N-0co 


Sie! 
Example 3.2.5 Show that Se —z converges. 
— n 


n=1 


Solution We could of course use the integral test, but now that we have the 


theorem we may simply note that this is a p-series with p = 3 > 1. 


Sle 
Example 3.2.6 Show that Dy —jz converges. 
n 


n=1 


Solution We know that if 8 1/ n* converges then 5/ n* also converges, 


inm=ll n=1 
co co 
by Theorem 2.3.1. Since ps 1/n* is a convergent p-series, » 5/n* converges 
n=1 n= 


also. 


=) & 
Example 3.2.7 Show that —— diverges. 
n=1 yn 
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= 1 
Solution This also follows from Theorem 2.3.4. Since oy —— is a p-series 


n=1 ut 


5 


4 


with p = 1/2 < 1, it diverges, and so does oS 
i 


3.2.5 Integrating for approximations 


Since it is typically difficult to compute the value of a series exactly, a good approx- 
imation is frequently required. In a real sense, a good approximation is only as 
good as we know it is, that is, while an approximation may in fact be good, it is 
only valuable in practice if we can guarantee its accuracy to some degree!. This 


guarantee is usually easy to come by for series with decreasing positive terms. 


co 


Example 3.2.8 Approximate SS 1/n? to two decimal places. 
n=1 
N 
Solution Referring to Figure 3.1, if we approximate the sum by SS line, 
n=1 


the error we make is the total area of the remaining rectangles, all of which 
lie under the curve 1/ x? from x = N out to infinity. So we know the true 
value of the series is larger than the approximation, and no bigger than the 
approximation plus the area under the curve from N to infinity. Roughly, then, 
we need to find N so that 


eal 
I ay es 1/100. 
N xX 


We can compute the integral: 


r ee! 
n x2 iN’ 


so N = 100 is a good starting point. Adding up the first 100 terms gives approx- 
imately 1.634983900, and that plus 1/100 is 1.644983900, so approximating 
the series by the value halfway between these will be at most 1/200 = 0.005 


' After all, m ~ 17 just with very bad error bounds. 
It is better to make a statement like |x -— 17| < 14, 
which is not only saying that 7 is “close” to 17, but is 
quantifying exactly how close (within 14—so perhaps 
not all that close). 


1 i 
It turns out that » = = ZZ 80 your approxima- 
c= lt 6 


tion of this series will also—in a roundabout way— 
yield an approximate value for x—and one which will 
be better than 17. 


in error. The midpoint is 1.639983900, but while this is correct to +0.005, we 
can’t tell if the correct two-decimal approximation is 1.63 or 1.64. We need to 
make N big enough to reduce the guaranteed error, perhaps to around 0.004 to 
be safe, so we would need 1/N ~ 0.008, or N = 125. Now the sum of the first 
125 terms is approximately 1.636965982, and that plus 0.008 is 1.644965982 
and the point halfway between them is 1.640965982. The true value is then 
1.640965982 + 0.004, and all numbers in this range round to 1.64, so 1.64 is 
correct to two decimal places. 

Since Ss aS = ay our estimate yields 

ae 6 


GZ 
1.63 < ai < NAGISy, 


and so 
9.78 < mn < 9.90. 


which means that 
BOT <p KS MAU, 


which is better than m ~ 3. And we have explicit bounds on the error. 
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Exercises for Section 3.2 


Determine whether each series converges or diverges. 


a) >) sa fs (5) Ma ‘> 
=I n=! 
(2) Los i 6) Ls i 
(3) LS 18> (7) La i115 
(4) zs im a Ee iin: 


fc) N N 
1 1 1 
9) Find N so that — is bet — and — + 0.005. 
(9) Find an N so tha’ oy “a is between y “a an > “4 + Mm 
n=1 Il n=1 
el sl eT 
(10) Find an N so that » a is between SS on and » a + 10+. Mm 
n=0 n=0 n=O 


[ec) N N 
Inn Inn Inn 
(11) Find an N so that Sy a is between », ro and SS = +0.005. 11> 
n=1 n= 


n=1 


[oc) N N 
i 1 1 
12) Find N that —— is bet ———- d —— + 0.005. 
(12) Find an N so tha’ 2a ann is ea) eaaet hae 


n=2 


> 
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3.3. More comparisons 


Armed with the ratio test and the integral test, it can be tempting to apply them 
co 


frequently. But when faced with a new series >» An, What should we do? First, 
n=1 
consider lim a, and if that limit is nonzero, then by Theorem 2.5.2 the series 
n—-oo 


diverges. If the series passes that first test, then it is worth considering other tests 


like the ratio test (perhaps if a, has factorials and powers) or the integral test (if 
an =f(n) and | f(x) dx is not too hard to compute). 


But the ratio test and integral test are not the only tools in our toolbox. The 


comparison test, which we discussed in Section 2.7, is extremely useful. 


co 


1 
Example 3.3.1 Does Sy 


ae 2 
2 ib a converge f 
2 g 


When I write log, I mean the natural logarithm. I 


Solution The obvious first approach, based on what we know, is the integral Dieie crine lon mcomirie Wt 


test. Unfortunately, we can’t compute the required antiderivative. But looking 
at the series, it would appear that it must converge, because the terms we are 


adding are smaller than the terms of a p-series, that is, 


1 1 


eS ee 3 
n2logn = n2 


when n> 3. Since adding up the terms 1/ n? doesn’t get “too big”, the new 


series “should” also converge. Let’s make this more precise. 
ll 1 


The i SS 
series yy ae a 


FORRES converges—all 
st LOB tt 


converges if and only if y 
n=3 


el 
we've done is dropped the initial term. We know that oy —z converges. Looking 
n 


n=3 
at two typical partial sums: 
1 1 1 1 1 1 1 1 
Sn = eee < reve = 
37log3 42log4 5? log5 melon C2 ~ 42 BY n2 


Since the p-series converges, say to L, and since the terms are positive, t, < L. 


Since the terms of the new series are positive, the s, form an increasing 
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sequence and Sp < tp, < L for all n. Hence the sequence {s,,} is bounded and 


so converges. 


Sometimes, even when the integral test applies, comparison to a known series 
is easier, so it is a good idea to think about doing a comparison before doing the 
integral test. 

Like the integral test, the comparison test can be used to show both convergence 
and divergence. In the case of the integral test, a single calculation will confirm 
whichever is the case. To use the comparison test we must first have a good idea as 


to convergence or divergence and pick the sequence for comparison accordingly. 


Example 3.3.2 Does converge? 


= 1 
Solution We observe that the —3 should have little effect compared to the n 
inside the square root, and therefore guess that the terms are enough like 


1/ Vn? = 1/n that the series should diverge. We attempt to show this by 


comparison to the harmonic series. We note that 


1 1 1 


= = ? 
Vn2—3 Vn2 on 


so that 
1 1 1 1 1 1 


f eg a5 al = ih, 
n 


alt | ig dome Ss 
y22=-3 V32-3  vne-3 2 3 


where t, is 1 less than the corresponding partial sum of the harmonic series 


Sn 


(because we start at n = 2 instead of n = 1). Since lim ty, = oo, lim sp = co 
n—-oco n-oco 


as well. 


So the general approach is this: If you believe that a new series is convergent, 
attempt to find a convergent series whose terms are larger than the terms of the 
new series; if you believe that a new series is divergent, attempt to find a divergent 
series whose terms are smaller than the terms of the new series. This is more of an 
art than a science, which is part of what makes these sorts of problems so much 


fun to do. 


Example 3.3.3 Does converge? 
nm 


= 1 
2, Vn? +3 
Solution Just as in the last example, we guess that this is very much like the 


harmonic series and so diverges. Unfortunately, 

1 1 
Roee a 
so we can’t compare the series directly to the harmonic series. A little thought 


leads us to 
1 1 1 


SS ee A 

VWn2+3 Vn?4+3n2 2n 
so if Ds 1/(2n) diverges then the given series diverges. But since s 1/(@n) = 
(1/2) yy 1/n, theorem ?? implies that it does indeed diverge. 
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Exercises for Section 3.3 


Determine whether the series converge or diverge. 


— 1 ~ logn 

1 — 6 

(1) 4 Fees > (6) Dy = (> 
~ 1 <1 logn 

(2) D Fees > (7) 2. = > 
n=2 n=1 
~ 1 1 

(3) mE Danae > (8) Ds logn > 
n=1 n=2 
— 3n+4 = oe 

® Dioesants ™ © Di omee 
n=1 n=1 
— 3n2+4 —  3n 

(5) YS es (10) ys Sas 


3.4 The mostly useless root test 


There is another convergence test called the root test, which can be justified with an 


argument not so different” from that which justified the ratio test in Subsection 3.1.1. 


The root test is very occasionally easier to apply, but usually not as good as choosing 
to use the ratio test. 


With those disparaging remarks out of the way, let us now state the root test. 


Theorem 3.4.1 (The Root Test) Consider the series > a, where each term 
nO 
An is positive. Suppose that lim (Gaye = L. Then, 
n-co 


e ifL< 1 the series Sy An converges, 
e ifL> 1 the series diverges, and 


e if L = 1, then the root test is inconclusive. 


Let’s apply the root test to analyze the convergence of a series. 
fee} Bn 
Example 3.4.2 Analyze 2, = 
nS 


Solution Usually, the ratio test is a good choice when the series involves n™ 


powers; in this case, the ratio test turns out to be a bit difficult on this series, 


since we have to calculate 


. Bel / (n+ Tate 
a 
n—0o 5r/ nn 
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? Indeed, justifying the root test makes a good exer- 
cise for you, the reader, so it is included among the 
exercises for this section. 
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and that may not be entirely obvious. So we, begrudgingly, apply the root test, 


which asks us to calculate 


Since L = O < 1, we may conclude that the given series converges. 


The root test is frequently useful when n appears as an exponent in the general 
term of the series—though the ratio test is also useful in that case. Technically, 
whenever the ratio test is conclusive (i.e., whenever lim an+)/an = L # 1), sois 
the root test—but not vice versa. In other words, the Toot test does work on some 


series that the ratio test fails on. 


Example 3.4.3 Find a series for which the ratio test is inconclusive, but the 


root test determines that the series converges. 


co 


Solution Here is such a situation. Try using the ratio test on oe An where 
n=1 
(an) is a sequence which “stutters” like 


1/2r/2 if nis even, and 


1/2'"+))/2 if nis odd. 


Note that a; = ag and ag = ay and as = ag, SO Gn+)/Qn is often 1, which 

messes up the ratio test—indeed, lim an; )/an does not exist in this case. 
n-oco 

Nevertheless, 


1/21/2 if nis even, and 


1/2("+1)/(2n) if nis odd, 


Ven, = 


and so lim Yan = 1/ V2 < 1, which means the sequence converges by the 


no 
root test. Admittedly, we didn’t need the root test: this series is just a geometric 
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series where the terms repeat, so it definitely converges. Still, it proves the 


point that the ratio test can fail while the root test succeeds. 
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Exercises for Section 3.4 


(1) Prove theorem 3.4.1, the root test. im 


(2) Compute lim lan|t/” for the series » 1/n?. ms 
n-oo 


(3) Compute lim fete for the series yy 1/n. 17? 
n-oco 


4 Alternating series 


4.1 Absolute convergence 


Roughly speaking there are two ways for a series to converge: As in the case of 
co 


DS 1/n?, the individual terms get small very quickly, so that the sum of all of 


n=1 


Co 
them stays finite, or, as in the case of » (a1) /n, the terms don’t get small fast 


n=1 
co 


enough US 1/n diverges), but a mixture of positive and negative terms provides 


n=1 
enough cancellation to keep the sum finite. You might guess from what we’ve seen 


that if the terms get small fast enough to do the job, then whether or not some 


terms are negative and some positive the series converges. 


Theorem 4.1.1 If |an| converges, then OS An converges. 


itl n=1 
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Proof Note that 0 < a; +|ay| < 2|a,| so by the comparison test - (an + lanl) 


n=1 
converges. Now 


. (an ar lanl) a 


n=1 n=1 


M 
1 
Me: 


(Gr + |an| — lanl) 


= 
Il 
_ 


l 
Me 
£ 


= 
Il 
_ 


converges by Theorem 2.3.4. 


co 


So given a series 9 An with both positive and negative terms, you should first 


n=1 
co 


ask whether ) |an| converges. This may be an easier question to answer, because 


n=1 
co 


we have tests that apply specifically to series with non-negative terms. If os |an| 


n=1 


fee} 
converges then you know that » An converges as well. If 3 |an| diverges then it 


n=1 
co 


still may be true that » An converges—you will have to do more work to decide 
n=1 
the question. Another way to think of this result is: it is (potentially) easier for 
co co 


an to converge than for oy |an| to converge, because the latter series cannot 
n=1 n= 
take advantage of cancellation. 


co co 
If y |aj| converges we say that > an is absolutely convergent; to say that 


n=1 n=1 
co 


SS An converges absolutely is to say that any cancellation that happens to come 
n=1 
along is not really needed, as the terms already get small so fast that convergence 


co co 
is guaranteed by that alone. If An converges but Sy |an| does not, we say that 


n=1 m=) 


With this terminology, Theorem 4.1.1 is saying that 
an absolutely convergent series is also a plain old 
convergent series. 
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co co 


1 
S An converges conditionally. For example, DS ie: — converges absolutely, 
n 


n=1 n=1 
co 


1 
while oS (-1)""!= converges conditionally. 
n 


n=1 


\ sinn 
Example 4.1.2 Does Se 


72 converge? 
n=2 


|sin n| 
DP 


Solution In Example 2.7.7, we saw that Sy converges, so the given 
n=2 


series converges absolutely. 


Example 4.1.3 Does S (- Il ) a On + 3n +5 converge? 
n n 


n=1 


| = 3n+4 


co 


Solution Taking the absolute value, 


n=1 


3n+4 


—————— diverges by comparison 
2n2+3n+5 ae a 


co 
3 
to S Oa so if the series converges it does so conditionally. It is true 
n 
n=1 


that Jim (3n + 4)/(2n? + 3n+5) = 0, so to apply the alternating series 
test we need to know whether the terms are decreasing. If we let f(x) = 
(3x + 4)/(2x? + 3x +5) then f’(x) = -(6x7 + 16x - 3)/(2x7 + 3x4 5)”, 
and it is not hard to see that this is negative for x > 1, so the series is 


decreasing and by the alternating series test it converges. 
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Exercises for Section 4.1 


Determine whether each series converges absolutely, converges conditionally, or diverges. 


AGO: Sree 
cas 
(3) Lo naan ms 
(4) ei rie > 


> 


> 


(5) 


(6) 


(7) 


(8) 


oe) 


» Sy 
Eee > 


Sy eee 1m 
ar +R 
yi 
=U See ms 
_)n arctan n oe 
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4.2 Alternating series test 


Next we consider series with both positive and negative terms, but in a regular 


pattern: the signs alternate, as in the alternating harmonic series for example: 


=) (-1)rt} 
» - 


1 
n=1 . 
1 
1 


1 at 


De 


In this series the sizes of the terms decrease, that is, |a,| forms a decreasing 
sequence, but this is not required in an alternating series. As with positive term 
series, however, when the terms do have decreasing sizes it is easier to analyze the 
series, much easier, in fact, than positive term series. Consider pictorially what 
is going on in the alternating harmonic series, shown in Figure 4.1. Because the 
sizes of the terms a, are decreasing, the partial sums sj, $3, S5, and so on, forma 
decreasing sequence that is bounded below by sg, so this sequence must converge. 
Likewise, the partial sums sg, s4, sg, and so on, form an increasing sequence that is 
bounded above by s), so this sequence also converges. Since all the even numbered 
partial sums are less than all the odd numbered ones, and since the “jumps” (that is, 
the a; terms) are getting smaller and smaller, the two sequences must converge to 
the same value, meaning the entire sequence of partial sums sj, So, S3,... converges 
as well. 


Figure 4.1: Partial sums of the alternating harmonic 
series 


NlRe+ 
— 
Oo 
fon) 
fo) 
| ol + 


There’s nothing special about the alternating harmonic series—the same argument 
works for any alternating sequence with decreasing size terms. The alternating 


series test is worth calling a theorem. 
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Theorem 4.2.1 Suppose that (an) is a decreasing sequence of positive num- 


bers and lim ap = 0. Then the alternating series S (-1)"*1 an converges. 


n—-co 
n=1 


Proof The odd numbered partial sums, s,, $3, S5, and so on, form a de- 
creasing sequence, because Sox%4+3 = Sak+1 — Gak+2 + Aek+3 < Sac4+1. since 
AoKn+2 = Agaxn43. This sequence is bounded below by so, so it must converge, 


say lim sox4+1 = L. Likewise, the partial sums so, S4, Sg, and so on, form 
k- 00 
an increasing sequence that is bounded above by s,, so this sequence also 
converges, say lim so, = M. Since lim ay = O and sox4 1 = Sok + Gok+1; 
k—-0o 


n—-0oo 


L= lim sox+1 = lim (Sok ct Aok+1) = lim sox + lim agn+1 =M+0=M, 
k- 00 k—-00 k-0o0 k—- 00 


so L = M, the two sequences of partial sums converge to the same limit, and 
this means the entire sequence of partial sums also converges to L. 


We have shown more than convergence: if we are careful about thinking about 


the previous argument, we can find error bounds. Let’s see how. Suppose that 
i Se (=1)" ta, 
n=1 
and that we approximate L by a finite part of this sum, say 
N 
Lx SiC)" aa. 
n=1 


Because the terms are decreasing in size, we know that the true value of L must be 


between this approximation and the next one, that is, between 


N N+1 
Ee and ened, 
iil n=1 


Depending on whether N is odd or even, the second will be larger or smaller than 


the first. This is important enough that it deserves to be highlighted as a theorem. 


We have considered alternating series with first index 
1, and in which the first term is positive, but a little 
thought shows this is not crucial. The same test 


co 


applies to any similar series, such as Sy (-1)"an, 


n=0 
di (-1)"an, by (-1)"an, ete. 
n=17 
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Theorem 4.2.2 Suppose that {a,}7_, is a decreasing sequence of positive 


co 


numbers and lim an = 0. By Theorem 4.2.1, we then know that » (- Weta 
ae 


n—-oo 1 
converges to some value, say L. Moreover, L is between 


N N+1 


Yi)? an and Dd) an. 


n=1 


Example 4.2.3 Approximate the alternating harmonic series to one decimal 
place. 


Solution We need to go roughly to the point at which the next term to be 
added or subtracted is 1/10. Adding up the first nine and the first ten terms 
we get approximately 0.746 and 0.646. These are 1/10 apart, but it is not 
clear how the correct value would be rounded. It turns out that we are able to 
settle the question by computing the sums of the first eleven and twelve terms, 
which give 0.737 and 0.653, so correct to one place the value is 0.7. 
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Exercises for Section 4.2 


Determine whether the following series converge or diverge. 


2 (-1)t41 

(1) ——_ i. 
yy 2n+5 
Ss (-1)ttt 

2) pane eee 

(2) a Waa ms 


(4) > (iyo i im 


1 
(5) Approximate yy (=1)""4 3 to two decimal places. 


n=1 


fo) 


1 
(6) Approximate s (-1)""1 —; to two decimal places. 
n 


n=1 


> 


> 


5 Another comparison test 


We’ve covered a ton of material thus far in this course; there is one more comparison 
test that comes in quite handy—the Limit Comparison Test—which we will meet in 
Section 5.2. The purpose of this chapter, however, runs deeper than “just” another 
comparison test. 

The emphasis on series has been almost entirely on the question of their conver- 
gence; we have not paid much heed to the value of the series, but we’ve developed 
a lot of techniques to analyze their convergence. The question is always “Does it 


1” 


converge?” and the answer is “yes, it converges!” or “no, it does not converge.” 
Considering how qualitative our answer is, we might hope that there are equally 
qualitative methods for analyzing series. If convergence is just a yes-or-no mat- 
ter, one might hope that the methods for analyzing series are equally loose and 
qualitative. 

But that hasn’t been our experience. Convergence is a tricky business, requiring 
precision and careful analysis. There have been hints, though, that things are easier 
than they seem: the comparison test is perhaps the best example of that. In your 
past mathematical life, you’ve probably been given “expressions” or “equations” to 
which you apply various rules in order to derive an answer. With the comparison 
test, the situation is less about rules, and more about creatively ignoring parts of 
the expression in order to find a useful bound. More than being rule-based, testing 
convergence via the comparison test requires some guesswork, and a willingness to 
ignore the parts of the expression that don’t matter, in order to get at the part that 
does. 


Let me be more precise. Suppose we wanted to analyze the convergence of a 
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series such as 
co 


Ss n* -—3n se 5) 
5 5 pe 
Sey A re ae 
This is a complicated series, but the given expression is the ratio between a fifth 


degree polynomial and a fourth degree polynomial, so this series “is more or less’ 


the same as the series 


which is the harmonic series, and diverges! This is how we’d like to think, but we 
need to justify the concept of “is more or less.” This is what Section 5.2 will teach 


us to do. 


5.1 Convergence depends on the tail 


The harmonic series diverges, but so does the series 


y 1 pe Seeeee 1 
Sy = SSS Se SIS Sa 
wo ~=—«2100 «101-102-103 


Convergence doesn’t depend on the beginning of the series; whether or not I include 


the first 99 terms 
1 1 1 ; ; 1 eee 1 
is epee 


ee 3 97 98 | 99 
does affect whether or the sum of all the terms diverges. In short, convergence 


depends not on how a series begins, but on how a series ends. The end of a series 


is sometimes called the tail of the series. 


co 
Definition Let N > 1 be an integer, and consider a series » An. The series 
n=1 
we get by removing the first N — 1 terms, namely 


is called a tail of the given series. 


Here is the theorem that describes how tails relate to convergence. 


Theorem 5.1.1 Let N> 1 be an integer. The series SS an converges if and 
n=1 


co 
only if y An converges. 
n=N 


This could be shortened to “The series converges iff a tail of the series converges,” or 


even just to the slogan that convergence depends on the tail. 


Proof Suppose » An converges to L, meaning 


n=1 


M 
lim GIL: 


M-co 
n=1 


In that case, applying limit laws reveals 


TSE, | 
=) 
Ms 
a 
a 
—” 
| 
ee 
3 2 
elo 
Qa 
=] 
—” 
ee” 


M 
lim ) a, = lim 
M- oo M- co 
n=N 


3 
Il 
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l| 
n=y 
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— 
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M 
which means the series Ds An converges. 
n=N 
The other direction is left to you, the reader. 


co 


1 
Example 5.1.2 Does the series » —> converge? 


2 
RS) 


co 
Solution Yes! This series is a tail of the convergent p-series » eo aus 
nr 
n=1 
case, p = 2. 


You might recall Example 3.1.1, which we'll redo here. 


COREA) 

n 

Example 5.1.3 Show that ) =a converges by using the comparison test and 
n=0 

Theorem 5.1.1. 


oo .B 
n 
Solution The given series converges iff De — by Theorem 5.1.1. But when- 
Bn 
n=23 
ever n => 23, we have 


9} mn 
The series ) (=) converges, since it is a geometric series with common 


n=23 
ratio 2/5, so by comparison, the smaller series S = also converges. 
n=23 


In light of Theorem 5.1.1, many textbooks will choose to write 


se 


CO 
instead of ) An when discussing convergence. Whether or not the series converges 


n=1 
doesn’t depend on the initial index, so if we want to state theorems about conver- 


gence, we can avoid potentially distracting details by simply not speaking about 


where the series begins. 


5.2 Limit comparison test 


This test is usually called the limit comparison test, 


Theorem 5.2.1 Suppose a, > 0 and b, = O. Then if 


a, 
lim — =L>0, 


noo Dn 


co co 
the series oy an converges if and only if SS bn converges. 


n=1 n=1 


The idea is that this is basically a comparison test, but instead of asking for 
something on the nose, like O < a, < bn, Iam instead asking only that a, and by, 


be similar in size. 


5.2.1 Proof of the Limit Comparison Test 


a, b 
Assuming lim — = L> 0, then we may also conclude that lim — = 1/L> 0. 


noo Dy n> Ap 


Theorem 5.2.2 Suppose a, => 0 and by, = O. Then if 


a, 
lm “ =L>0, 


noo Dn 


co co 
the series ) an converges if and only if ) bn converges. 
fi ial 
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5.2.2 How to apply the Limit Comparison Test 


Example 5.2.3 Does the series 


converges or diverge? 


Solution We will invoke the Limit Comparison Test, that is, Theorem 5.2.2. 
Set 


n?—3n+5 re 1 
ral ———s 
"9nd + 5n3 — n2 in 
so in this case, 
a n*-3n+5 on 
lim = lim 


= lim 
noo 2n®+5n3—n2 1/n° 
— 1-34+5 

= lim z ; 
ica ae 
: 3 5 
imyao(1 3+ 8) 
ita Ss) 
1 

== > 0), 
2 


co co co 
and so yy An and bn share the same fate. But bn, diverges, and so 
n=52 n—52 n=52 


co 
too does a Glang 
i — oo 


Of course, we could have just used a direct comparison test; the big benefit here is 


that it is relatively painless to compute the limit, but it requires significant creativity 
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to set up a direct comparison test. Think back, for instance, to Example 3.1.1. 


6 Power series 


6.1 Definitions 


At first, we studied the geometric series 


1 
but then we replaced — with a variable, so we were able to analyze all geometric 


series simultaneously. In the end, we discovered that 


k 
i — Te Se 


and that the series diverges when |x| > 1. At the time, we thought of x as an 
unspecified constant, but we could just as well think of it as a variable. A number 


which depends on another number is just a function, so we may write 


and then observe that it is also the case that f(x) = k/(1-.x), as long as |x| < 1. 


While k/(1—-.x) is a reasonably easy function to deal with, the more complicated 
Oe kx" does have its attractions: it appears to be an infinite version of one of the 
simplest sorts of functions—a polynomial. Do other functions have representations 


as series? Is there an advantage to viewing them in this way? 


You may recall that we used r instead of x; I think r 
was a good choice back then, since r evokes “ratio” 
and stood for the common ratio between the terms 
in a geometric series. Now we use x, which I think 
is a good choice now. Why the change? To me, x 
suggests “independent variable of a function” much 
more generally than just a parameter in a geometric 
series, and we will be thinking very broadly about 
how quite general functions can be represented as 
a power series. One may regard power series as a 
natural generalization of polynomials, and you may 
already be comfortable thinking of x as the variable 
in a polynomial. 
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Usually the coefficients aren’t all the same in a polynomial; the geometric series 
is somewhat unusual in that all the coefficients of the powers of x are the same, 
namely k. We will need to allow more general coefficients if we are to get anything 


other than the geometric series. 


Definition Let (a,) be a sequence of real numbers starting with ap. Then the 
power series associated to (an) is 


Despite appearances, we will not be regarding such series as “power series.” Since 


(an) is a sequence of real numbers, the coefficients a, cannot depend on x. 


6.2 Convergence of power series 


Example 6.2.1 Consider the power series 


fi) = = 


n=1 


For which x does this converge? 


Another way to think of this question is this: we are being asked to determine 


the domain of f. 
Solution We can investigate the convergence of this series using the ratio test. 


The difficulty now is that, instead of a single limit, we must now compute a 
limit than involves a variable x which is not the variable with respect to which 
we are taking a limit. 

Another issue is that x may be negative, so we will actually check absolute 


In Example 6.2.1, note that we are no longer con- 
sidering convergence of a single series; instead, by 
regarding x as a parameter, we are considering con- 
vergence for a whole family of series—namely all 


those of the form Ss x"/n. It often happens in 
n=1 
mathematics that it is wiser to study a family of 


objects simultaneously than to study a single object 
in isolation. 
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convergence; in other words, we are actually considering 


eo) n 
5e 
f(x) =) |=}. 
n 
n=1 
Bravely, 
|x 
L= lim 2 
nooo |x|" 
n 
elmo 
= lim = 
noo n+] ix" 
n 
; | feere n 
= lim 
nocon+1 |x|" 
= |x| n 
n—>co (n+ 1) |x|" 
n 
= lim |x| = |x|- lim = |b 
n->co noo n+] 


So when L = |x| < 1, the ratio test says that the series converges absolutely. 


When |x| > 1, the series does not converge absolutely—in fact, when |x| > 1, we 
have that 


nm 


pees 
lim — #0 


ne nN 
and so the series diverges. 

So when |x| < 1 the series converges and when |x| > 1 it diverges, which 
leaves only two values in doubt. When x = 1, the series is the harmonic series 
and diverges; when x = —1, it is the alternating harmonic series (rather, the 
negative of the “usual” alternating harmonic series) and converges. 


In other words, we may regard f as a function with domain [-1, 1). 


We analyzed this power series by invoking the ratio test, but that was no accident. 
We will see that the ratio test applied to a power series will always have the same nice 


form. Feeling confident from our display of bravery before the preceding example, 
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let’s attack the general case of a power series 


When does this series converge absolutely? Applying the ratio test again, we find 


k a e[xierl 
eee lan+il- xl 
neo |ap| + |x|" 
: a 
nel lan+1l 
n—oo lanl 
Sie lan+1l 


So the series converges absolutely whenever L < 1, but in this case, L depends in a 
rather uncomplicated way on |x|. The whole story is controlled by a limit that does 


not depend on x, namely 


Whe en la@n+1| 


° 
neo an 


which you see I have presciently related to a hitherto unmentioned variable, R. So 
the series converges absolutely whenever |x|/R < 1, meaning the series converges 
absolutely whenever |x| < R. When |x| > R, the series diverges!. 

Once again, only the two values x = +R require further investigation. In any 


case, if we begin with a sequence (a,) for which 


, a 
elie nal 

noo lanl 
[oe] 


the associated power series ys Anx" will converge for values of x in the interval 
n=0 

(—R, R), and it may even converge (or not, depending on the specific situation) at 

x = Ror at x = —R, so sometimes the interval on which the series makes sense will 


be [—R, R) or (—R, R] or even [-R, R]. 


' This is a consequent of the ratio test, but perhaps 
we haven’t emphasized it enough; if L > 1 in the 
ratio test, then the limit of the terms is not zero, so 
not only does the series not converge absolutely—the 
original series diverges, too, by the limit test. 
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Definition The set of values of x for which the series an x" converges is 
n=0 
the interval of convergence. 


As a consequence of the above discussion, the interval of convergence of a power 


series always have a nice form. 


Theorem 6.2.2 For a power series, the interval of convergence is, in fact, an 
interval. It has the form (-R, R) or [-R, R) or (—R, R| or [-R, R]. In short, it is 


centered around O. 


Because the interval of convergence is, indeed, centered around O, and because 
we often don’t care about what happens at the endpoint, it is often convenient to 


just describe R. 


Definition In the interval of convergence of a power series, the value R is 
called the radius of convergence of the series. 


Two special cases deserve mention. If 


é a, 
iim | n+1\ =@ 


noo lan| 


9 


then we might say “R = oo” since no matter what x is, the product 


. [Gn+41l 
|x| lim = 


> 
noo lanl 


co 


and therefore for all values of x, the power series Dy an x" converges. So the radius 
n=0 
of convergence, R, is infinite. 


The opposite may happen as well. It may happen that 


. [An+¢il 
lim = 


noo |a,| 


2 
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in which case the only way that 


. [an4il 
|x| lim 
neo |ay| 


<1 


is when |x| = 0. The interval of convergence is just the single point {0}. And in this 


case, we say R= 0. 


Warning People often confuse “radius of convergence” with “interval of con- 
vergence.” For starters, the radius of convergence is a single number, while 
the interval of convergence is, well, an interval (though it was defined as just a 
set—the fact that the set where the series converges is an interval was a theorem 
and was certainly not obvious—perhaps the first of many lovely surprises with 
power series). 

There is another difference between the radius of convergence and the 
interval of convergence; it is not simply that they are the same information 
in different packages. The radius of convergence cannot distinguish between, 
say, (—R, R) versus [—R, R]. The interval of convergence contains the extra 
information about what is happening at the endpoints. So a homework question 
which asks you to find the radius R is much easier than a homework question 
asking you to find the interval. 


6.3 Power series centered elsewhere 


If we are speaking of the “radius” of convergence, you might wonder about the “center” 
of convergence. Thus far, our intervals of convergence have been centered around 
the origin, but by changing the series, we can move the interval of convergence. 
Let’s see how. 


Consider once again the geometric series, 


f(x) = D1 xt = =~ for xe (-1,1). 


1-x 


Whatever benefits there might be in using the series form of this function are only 
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available to us when x is between —1 and 1. We can address this shortcoming by 


modifying the power series slightly. 


valid on the interval 


Example 6.3.1 Find a series representation for 


(-5, 1). 


Solution Consider that the series 


eS a = eee: 
n=0 oF Te 3 i. poo = 


because this is just a geometric series with x replaced by (x + 2) /3. Multiplying 
both sides by 1/3 gives 


py eee 
ar Sar lL aae 


the same function as before. For what values of x does this series converge? 


Since it is a geometric series, we know that it converges when 


Ix+2|/3 <1 
besa < 3 
=8 < S47 DQ <8 


-5<x<l. 


So we have a series representation for 1/(1-—.x) that works on a larger interval 
than before, at the expense of a somewhat more complicated series. The 
endpoints of the interval of convergence now are —5 and 1, but note that those 
two endpoints can be described as -2 +3. We say that 3 is the radius of 


convergence, and we now say that the series is centered at —2. 


et’s capture this in a definition. is worth contrasting Definition wi efini- 
Let’s capt th definit It th contrasting Definition 18 with Defi 
tion 15, our original description of power series. In 


particular, ys a, x" is a power series centered at 


n=0 
Zero. 
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Definition Let (a,) be a sequence of real numbers starting with ap. Then the 
power series centered at c and associated to (an) is the series 


In Example 6.3.1, we formed a series that involved (x + 2)", meaning that in 
that case c = —2. 

You are now in a position to try your hand at finding the radius of convergence 
and sometimes even the interval of convergence for some power series. I encourage 
you to cook up your own power series, and then see what you can say about the 


radius and interval of convergence. 
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Exercises for Section 6.3 


Find the radius and interval of convergence for each series. In exercises 3 and 4, do not 
attempt to determine whether the endpoints are in the interval of convergence. 


(1) See 111 
n=0 

(2) = (>> 
aa 
eal 

(3) » dae 111 
ma © 


! 


(4) ence im 


n= 
co 12 
(5) Ys ao (x-2)" itt 
n= 
Sy Cee) 
(6) Dean) i> 


(7) Find a power series with radius of convergence 0. __|Ill> 
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6.4 Calculus with power series 


Now we know that some functions can be expressed as power series, which look 
like infinite polynomials. Since calculus, that is, computation of derivatives and 
antiderivatives, is easy for polynomials, the obvious question is whether the same is 


true for infinite series. The answer is yes! 


co 


Theorem 6.4.1 Suppose the power series f(x) = S An(x-c)" has radius 


of convergence R. Then 


al 
a Ge n+l 
C mad > 
a ream c) 


[ fe a 


for values of x in the interval (c— R,c + R). The two new series have radius of 
convergence R, just like the original series. 


3 
Example 6.4.2 Find an alternating series for log (5). Approximate this value 
to two decimal places. 


Solution Begin with the geometric series, namely 


POWER SERIES 


Then integrate term-by-term to find 


1 Sk 
f ae = tog - x1 = a 
1-x Ontl 


- i 
log|1-x| = )) - genre 
a mae Il 


for real numbers x such that |x| < 1. To compute log(3/2), we should choose 
x = —1/2. In that case, 


log(3/2) = log(1 --1/2) 


= 1 1 
— 7] ye 
Sorte 


and so 
1 1 1 1 1 1 1 909 
log(3/2) » ~-=4 = se = 
2 8 24 64 160 384 896 2240 
= 0.406. 


Because this is an alternating series with decreasing terms, we know that the 
true value is between 909/2240 and 909/2240 — 1/2048 = 29053/71680 ~ 
4053, so log(3/2) is, to two decimal places, 0.41. 


] Example 6.4.3 What about log(9/4)? Find an approximate value for it. 
Solution Since 9/4 is larger than 2 we cannot use the series directly, but 
log(9/4) = log((3/2)”) = 2log(3/2) ~ 0.82, 


so in fact we get a lot more from this one calculation than first meets the eye. 
To estimate the true value accurately we actually need to be a bit more careful. 
When we multiply by two we know that the true value is between 0.8106 


and 0.812, and so, rounded to two decimal places, the true value is 0.81. 
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Exercises for Section 6.4 


(1) Find a series representation for log2. | 
(2) Find a power series representation for 1/(1—x)?. 1m 
(3) Find a power series representation for 2/(1—- x)3. > 


(4) Find a power series representation for 1/(1—- Palen What is the radius of convergence? 


> 


(5) Find a power series representation for i log(1—x) dx. | 


7 Taylor series 


We have seen that some functions can be represented as series. But thus far, our 
only examples have been those that result from manipulation of our one fundamental 


example, the geometric series. We might start with 


1 [oe] 
—— yy x" when |x| < 1, 
I= 38 = 


and then, say, integrate term-by-term to get a formula for a logarithm, as we did in 
Example 6.4.2. Instead of starting with a series representing a function, and then 
messing around with the series to find more functions represented by series, we 
should start with a function, and then try to find a series that represents it—if that 


is possible! 


7.1 Finding Taylor series 


The easiest case is when the function f is given to us as a power series already! 
co 


Suppose that f(x) = y anx" on some interval of convergence, say, when |x| < 


n=0 
R. Then we know, by Theorem 6.4.1, that we can compute derivatives of f by 


It might seem that considering this case is pointless: 
who cares about representing a function by a power 
series if the function is given to us as a power se- 
ries? The point is not to come up with a new power 
representation: the point is to relate the derivatives 
of the function to the coefficients of the power series, 
which is the sort of thing that generalizes. By study- 
ing a case we already understand completely, we are 
seeking insights which will apply even in cases we 
don’t fully understand. 
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differentiating the series term-by-term. Let’s look at the first few derivatives. 


= 
& 
II 
Ms: 
5 
=| 
sad 
Pa] 
| 
2 
iS} 
e 
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(ee) 
& 
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iS 
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n(n- Danx =2¢5 4 3 2asx 4 Sage 


3 
3 

I 
Me 


-) 
Il 
I) 


n(n—-1)(n-2)ayx" 3 = 3-2a3+4-3-2ayx+--- 


I 
Me 


F(x) 


=} 
Il 
wo 


By examining these derivatives, we can discern the general pattern. The k™ 


derivative must be Recall that, for a function f, we write its kt” deriva- 
tive by writing f (k) So the it” derivative evaluated 
at x is written f(") (x). 


(k—1)(k-2)---(2)(1)ax + (ke + 1)(k) +++ (2) dep 1x + 
+ (k+2)(k+1)++(3)acpox* ++, 


f(x) = y MC LG) Grae ee | reer 
Ie 


but we can write this more easily by using factorials, namely 


k+2)! 
( oy ) ogee 


ae I 
Ff) (x) = oy ax = klag + (ke + 1)!aypix + 
na 


Now, substituting x = 0 yields 


= n! 
f° (0) = day + — =a, 0 5 — hag, 
Dy (n z k)! 
and solving for a; gives 
29) 
ak = kel ; 


So if a function f can be represented by a series, we know just what series it is! We 


know the series because we know the derivatives of f. Note that a, =f") (0)/k! makes sense even when 
k = O, since in that special case, we have ag = 
f°) (0)/0! = f(0) because the zeroth derivative of f 
is f itself, and 0! = 1. 


TAYLOR SERIES 119 


Definition Given a function f, the series 


coe A (au) 
oy i (0) xn 
= n! 


is called the Maclaurin series for f, or often just the Taylor series for f 
centered around zero, since it is a power series centered around zero in the 


sense of Section 6.3. 


Let me warn you that, in order to write down this power series, you had better be 
able to take first, second, third—indeed, n‘"—derivatives at zero, because the given 


formula involves f (n) (0). And there is a worse warning. 


Warning Even if f is infinitely differentiable at zero (meaning f(”) (0) makes 


sense), even if I then write down 


a f'(0) 
Sire 
n=0 i 


n 


does not mean that I have a power series for f valid on any open interval! All I 
have done is written down the power series that must represent f assuming it 
has a power series representation at all! Nobody is promising you that some 
function you find—even if it is infinitely differentiable—actually has a power 
series representation. In other words, I am not claiming that there is an R # 0 


so that (n) 
SO) 
se) = ———.x' for x € (-R, R). 
F(x) Dy =; (-R,R) 
All I am claiming is that if f has such a power series, then I can find it by taking 
derivatives. 


Let’s see this worked out in an example we already understand, namely, for the 
function f(x) = 1/(1-x). 
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Example 7.1.1 Find a Taylor series for f(x) = 1/(1-—.x) centered around 


Zero. 


Solution We need to compute the derivatives of f, and then hope to spot a 


pattern. Here we go: 


f(x) = (1-x)7, 
f’(x) = (1- x), 
f(x) = 2(1- x), 
Sf" (x) = 6(1- x), 

f) = a4l(1-x), 


I see the pattern! 
(EO) nil =O). 
n! n 
and the Taylor series centered around zero is 


which we already knew—it is just the geometric series. 


So given a function f, we may be able to differentiate it around zero, spot a 
pattern, and thereby compute the Taylor series, but that does not mean we have 
found a series representation for f. Worse, we don’t even know if the series we wrote 


down converges anywhere, let alone converges to the function f{! The miracle is that 


for many popular functions! the Taylor series does converge to f on some interval. 


But this is certainly not true of all functions—or even true of most? functions! 


As a practical matter, if we are interested in using a series to approximate a value 


of a function at some point, we will need some finite number of terms of the series. 


' Arguably, this is not so surprising: maybe these 
are popular functions precisely because they have 
nice properties. That the sky is sky-colored is not so 
surprising as the fact that it is blue. 

? Most functions are probably not even continuous, 
let alone infinitely differentiable, let alone having the 
property of having a power series representation! 
The latter mouthful is usually termed real analytic. 


Even for functions with terrible looking derivatives, we can compute the initial terms 
using computer software like Sage. If we want to know the whole series—that is, the 
n” term in the series for an arbitrary n—then we need a function whose derivatives 
fall into a pattern that we can discern. A few of the most popular functions have 


nice patterns. Let’s see some now! 
] Example 7.1.2 Find a Taylor series for sin x. 


Solution The derivatives are quite easy, namely 


and then the pattern repeats. We want to know the derivatives at zero, so 


those are 
f’ (0) =cosO = 1 
f’ (0) =-sin0 =0 
f’’ (0) = -cosO = -1, 
fC) = sin0 = 0, 


and then the pattern repeats, namely it goes—starting from the zeroth derivative— 
like this: 


co 
3 5 xentl 


(2n+ 1)! 


Sometimes people are confused by the fact that the exponent in this power 


series is 2n + 1 instead of just n. It turns out that setting it up this way, 


2n+1 even number 


with x , hicely manages to kill all the terms x which have a zero 
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coefficient, since differentiating f an even number of times results in + sin x, 
which is zero when x = 0. 

But there is more to be anxious about. Before worrying whether this series 
converges to sin x, we should ask the prior question: does this series converge 
anywhere? Let’s determine the radius of convergence by using the ratio test, 


which asks us to consider 


|xPrts (2n+1)! 


L= lim 
ne (2n+3)! |x|?nt1 
2 
x 
= lim Ix| = (0), 


noo (2n+3)(2n+ 2) 


and so the series converges regardless of what x is. It will turn out later, by 


applying Theorem 7.2.1, that this series does converge to sin x. 


Sometimes the formula for the n™ derivative of a function J is difficult to discover, 
but a combination of a known Taylor series and some algebraic manipulation leads 


easily to the Taylor series for /. 
| Example 7.1.3 Find the Taylor series for f(x) = xsin(—x) centered at zero. 


Solution To get from sin x to x sin(—x) we substitute —x for x and then multiply 
by x. Let’s do the same thing to the series for sin x, namely 

es (=xje"r2 oS 5 xentl 
x =| PA! ae Te (al 7) 

Fy hey 


xenr2 


Spl? (Qn+1)! 


n=0 


Of course, we could have differentiated f(x), which would have yielded 


f’ (x) = —xcos (—x) + sin (-x) = 0, 
f(x) = —xsin (—x) - 2 cos (-x) = -2, 
f’’ (x) = xcos (-x) — 3 sin (-x) = 0, 

N63) casa (-x) +4 cos (—x) = 4, 


but maybe it would have been harder to pick up on the pattern that way. 


As we have seen in Section 6.3, a general power series can be centered at a point 
other than zero, and the method that produces the Taylor series can also produce 


such series. 


Definition Given a function f, the series 
oo F(n) 
Sy L (c) (x - eye 
fa n! 


is called the Taylor series for f centered around c. 


Let’s see an example, reminiscent of Example 6.3.1 but attacked with a different 
method. 


] Example 7.1.4 Find a Taylor series centered at —2 for 1/(1-.x). 


co 


Solution If the series is DS an(x + 2)" then looking at the kth derivative: 
n=0 


ki(1—x) 1 = Ds one 
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and substituting x = —2 we get k!3_“"! = kla, and a, =3 ©! =1/3*"", so 


the series is 
wiesue 
oS @ypiaril 


n=0 


Exercises for Section 7.1 


For each function, find the Taylor series centered at c, and the radius of convergence. Do 


not worry about whether or not the series converges to the given function—that will be our 


concern in Section 7.2. 


() 


(10) 


cosx aroundc=0O, | 

e* aroundc=0, 
1/xaroundc=5 iim 

logx aroundc=1 |i» 
logx aroundc=2 |i» 
1/x? aroundc=1 im 
1/V1l—xaroundc=O im 


? 


Find the first four terms of the Taylor series for tan x centered at zero. By “first four terms’ 
I mean up to and including the x? term. [i> 


Use a combination of Taylor series and algebraic manipulation to find a series centered 
at zero for xcos(x?). |i 


Use a combination of Taylor series and algebraic manipulation to find a series centered 
at zero for xe-*. 11> 
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7.2 Taylor’s Theorem 


In Section 7.1, we were finding Taylor series without worrying at all that what 
we were finding actually related to the original function {. We now remedy this 
oversight. 

Our whole mission in this, Chapter 7, was to start with a function, then write 
down a power series converging to f, with the plan that we might finally use that 
power series to, say, approximate values of the function, among other things. What 
we have done thus far is assumed a function had such a power series representation, 
and then deduced that the coefficients are somehow related to the derivatives of f. 
So does the power series converge to the function? 

And if the power series we got in Section 7.1 does converge to f, how good is the 
approximation? I mean, if I just consider the first N terms of the power series, am 
I close to f at all? How close? Remember our experience with alternating series? 
For alternating series, Theorem 4.2.2 not only gave a test for convergence: it also 
bounded how far the N“ partial sum could be from the true value of the series. 


Let’s see a similar sort of “error estimate” for power series. 


Theorem 7.2.1 (Taylor’s theorem) Suppose that f is defined on some open 
interval I = (a— R,a+R) around a and suppose the function f is (N + 1)- 
times differentiable on I, meaning that f(Y*) (x) exists for x € I. Then for each 
x # ain I there is a value z between x and a so that 


Wo AR a (N+1)( 
19) = YO (a= a)" 4 FS x= ay 


N+1) on the interval between 


The upshot here is that, by bounding the function f ( 
x and a, we manage to bound the difference between f(x) and the partial sum. 
See Example 7.2.2 for an example. But before we get to the example, let’s prove 
Theorem 7.2.1; the proof perhaps seems unmotivated, since we'll be “clever” in 
setting things up, but I hope you will be able to follow the argument, even if you 


don’t trust that you could have created the proof ex nihilo. 
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Proof Define the function F(t) by 
NY ¢(n)(¢ 
ie) = DS ee) (x-t)"+ B(x-t)"*? for t between a and x. 
n! 
n=0 


Here we have replaced a by t in the first N + 1 terms of the Taylor series, and 
added a carefully chosen term on the end, with B to be determined. Note that 
we are temporarily keeping x fixed, so the only variable in this equation is t, and 
we will be interested only in t between a and x. If we set t = a, then we get 


n! 


Nl) (q 
F(a)= ))* A oa Bie salneh 


Set this equal to f (x): 


N e(n)(q 
pe) = VE (ea) + Ble ay 


Since x # a, we can solve this for B, which is a “constant’—it depends on x and 
a but those are temporarily fixed. Now we have defined a function F(t) with 
the property that F(a) = f(x). Consider also F(x): all terms with a positive 
power of (x - t) become zero when we substitute x for t, so we are left with 
F(x) = f°) (x)/0! = f(x). So F(t) is a function with the same value on the 
endpoints of the interval [a,x]. By Rolle’s theorem, we know that there is a 
value z € (a,x) such that F’(z) = 0. Let’s look at F’(t). Each term in F(t), 
except the first term and the extra term involving B, is a product, so to take the 
derivative we use the product rule on each of these terms. It will help to write 
out the first few terms of the definition: 


f) (t) 
3! 


Cece (eat eee 
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Now take the derivative: 


f(t ‘ FR (t F 
{FP o1en + Geo 
F(t) 2 f(t) 3 
[SP e—reryGPte- 09] 4-04 
(N) (N+1) 
[Seon +4 7 (t) x-9"| 


Now most of the terms in this expression cancel out, leaving just 


(v1) 
P(t) =t 8 (1) + BON + 1)(x—"(E1), 


At some z, F’(z) = 0 so 


fae z N N 
0= see =) + B(N +1)(x-2z)%(-1) 
(N+1) Z 
B(N +1)(x—z)" <4 ee 
Se ee) 
2 (N+1)! 
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which is what we wanted to show. 


It may not be immediately obvious that this is particularly useful, so let’s look at 


some examples of Theorem 7.2.1 in action. 


Example 7.2.2 Suppose x € |—1/2, 1/2]. Find a polynomial approximation 


for sin x accurate to 0.005. 


Solution Note that if we can compute sin x for x € [-1/2, 1/ 2, then we can 
compute sin x for all x. So what we are asking for here is actually quite general! 
Once we figure out how to calculate sin x for x € [—7/ 2,1/ 2), we can shift any 
other value of x into that interval, and thereby compute sin x. 

Let’s get started. From Theorem 7.2.1, we have that 


N ¢(n)(q (+1) (z 

sinx = TAs, (x-a ny FO) (gy for some z between a and x. 
ae (N+1)! 

What can we say about the size of that “error” term? In other words, how big 


could 


possibly be when z is between x and a? Every derivative of sin x is either + sin x 
or + cos x, so [f("*1) (z)| < 1. The factor (x— a) *? is a bit more difficult, since 
x —a could be quite large. To simplify matters, let’s pick a = 0. We need to 
pick N so that 


< 0.005. 


N41 
lien 


Since we are only considering the case when x € [-1 WD, iff DAP we have 
N+1 9N+1 


S (N+ 1)! 


(N+1)! 
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The quantity on the right decreases with increasing N, so all we need to do is 


find an N so that 
gN+1 


(N +1)! 
A little trial and error shows that N = 8 works, and in fact of /9! < 0.0015. 


Consequently, 


< 0.005. 


x" + 0.0015 


8 ¢(n) 
sinx = J aw 
n=0 i 
3 5 T 
=x- } 


= + 0.0015. 
6 120 5040 


Figure 7.1 shows the graphs of sin x and and the approximation on [0, 37/2]. 

As x gets larger, the approximation heads to negative infinity very quickly, 

since it is essentially acting like ae. 

We can extract a bit more information from this example. If we do not restrict 
the value of x to lie in the interval x € [-7 D2, GE}! PAB we still know that 


pa) Nt 
(N +1)! 


xNrl 


(N+ 1)! 


because the derivative f+!) (z) is either + sin z or + cos z. We can use this to prove 


the following result. 


Theorem 7.2.3 For all real numbers x, 


co =il n 
sinx= J ) ger 


on 8)! 


Proof If we can show that 


Figure 7.1: A plot of f(x) = sinx with a thick line, 
placed alongside the dotted line y = x, a dashed 
83 
OG 
plot of y = x- fae and a thin solid plot of y = 
5 x 
x= ie + —. Note how successively higher partial 


120° 
sums of the Taylor series are hugging the graph of 


sin x increasingly well. 


for each x, then we know that the error term 


fe OY as Biles 
(N+ 1)! ~|(N+1)!) 


N+1 


is, in the limit, zero, and so we may conclude that 


x2nrl 


=a Caan 


In other words, we will conclude that the sine function is actually equal to its 
Taylor series around zero for all x. But how can we prove that the limit is zero? 

Suppose that N is larger than |x|, and let M be the largest integer less than |x|. 
If M = 0, then x‘*! is small, and even smaller after dividing by (N + 1)!. On 
the other hand, if M > 0, then just a bit more work is called for. We compute that 


JN] —_ em bd etd ot 
(N+1)) N+1NN-1 M+1MM-1 21 
eo ie IE es 
= NA MM-1 2 Il 
_ _ bet lM 
N+1 M!" 


The quantity |x|“ /M! is a constant, so 


Pelosi ms 
im — = 
Noo N+ 1 M! 


and by squeezing via Theorem 1.7.2, 
N+ 


(N+ 1)! 


N-co 


as desired. 


Essentially the same argument works for cos x, which yields the following. 
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Theorem 7.2.4 For all real numbers x, 


cos xX = y 8 on 
4 (2n)! 
n=O) 


And similarly, the function e* is real analytic, meaning that the Taylor series 


for e* converges to e*. 


Theorem 7.2.5 For all real numbers x, 


Example 7.2.6 Find a polynomial approximation for e* near x = 2 accurate 
to +0.005. 


Solution From Taylor’s theorem: 


Z 
2) 


Nie? 

e 
oo pace = Bye ee ie eae F 
% tent "+ Wa) 


since f wy (x) = e* for all n. We are interested in x near 2, and we need to 


Sirnl 


control the size of |(x — 2) so we may as well specify that |x - 2| < 1, 


meaning x € [a S|. Also 


so we need to find an N that makes e?/(N +1)! < 0.005. This time N = 6 
makes e?/(N +1)! < 0.004, so the approximating polynomial is 


2 2, 2 2, 2, 


x 2 2 e D1 has ie 5 
= aa ee awe ee eae cia 
e=e+e(x-2)4+ 3 (x e+ 6 |X ) yi Gs ) a eT yeo+ 


This presents an additional problem for approximation, since we also need to 
approximate e”, and any approximation we use will increase the error, but we 


will not pursue this complication. 


Note well that in these examples we found polynomials of a certain accuracy only 
on a small interval, even though the series for sinx and e* converge for all x. This 
is usually how things work out. To get the same accuracy on a larger interval, what 


can you do? Use more terms! 
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Exercises for Section 7.2 


(1) 
(2) 


Find a polynomial approximation for cos x on [0, z], accurate to +1073 im 


How many terms of the series for log x centered at 1 are required so that the guaranteed 
error on [1/2,3/2] is at most 10-°? What if the interval is instead [1,3/2]? i111 


Find the first three nonzero terms in the Taylor series for tanx on [-1/ 4, 1/ 4, and 
compute the guaranteed error term as given by Taylor’s theorem. (You may want to use 
Sage or a similar aid.) 1m 


Prove Theorem 7.2.4, that is, show that cos x is equal to its Taylor series for all x by 
showing that the limit of the error term is zero as N approaches infinity. 1m 


Prove Theorem 7.2.5, that is, show that e* is equal to its Taylor series for all x by showing 
that the limit of the error term is zero as N approaches infinity. |11m 


Review 


These problems require various techniques, and are in no particular order. Many 
problems may be done in more than one way. 

I also encourage you to try your hand at crafting your own problems: mathematics 
is more than answer-getting—it is also about problem-posing! Building your own 
problems will give you a strong sense of the limitations of the machinery we have 
built in this book. 
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Exercises for Section 7.2 


Determine whether the series converges. 


n=0 n? 
(8) Ma > 
=O 
~ n! 
e ah eee -(2n-1) a 
(10) je >> 
aaa, WL n 
aD 1 ee os _ 4 ae 
Dagios, | Botlag " Aewiee | Rewey | = 


(12) yee i115 


iI 

(13) Se m3 
=n! 
ee (=i)? 


(14) 


ey gn n-1 
(15) » Mm 
iI 
52 ae 58 58 
(iG) aa ae | (2-42 t (4-62 t (24-682 fees {LE 


(17) SY) sin(1/n) 11> 
n= 


Find the interval and radius of convergence; you need not check the endpoints of the intervals. 


(18) Sy a > 
eae! 
co xi 
(19) ea 
(20) 1 (11> 
= neoye 
132  e@s2  laBiobi az 
(21) x4 es 
2 2°45 2-4-6 7 
eral 
(22) y x >> 
n= ut 
= (aie Qn 
(23) aes (>> 
”) n23 
(24) SS ea) 11> 


3 
I 
° 


Find a series for each function, using the formula for Maclaurin series and algebraic 
manipulation as appropriate. 


(25) 2* im 

(26) In(1+x) im? 
Il sr 3% 

(27) In (=) ms 

(28) 1+x 1! 

(29) Tee Mm 

(30) arctan(x) 1m 


(31) Use the answer to the previous problem to discover a series for a well-known mathematical 
constant. |i» 
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Epilogue (or. . . what happens to Harry?) 


The worst part about reading a great? novel is that last page. The book gets thinner 
and thinner, and then, poof! Not just the characters, but the whole world that the 
author has crafted for them is gone! And how frequently I want to stay in that world 
just a bit longer. 

Humanity has found an antidote to novel-endings; this antidote is the sequel. 
With a name like “Calculus Two” you might be getting the idea that there is a 
Calculus Three, and who knows. . . maybe! 

A-hundred-and-some-odd*-pages ago, I pointed out that reading mathematics 
is not the same as reading a novel. This book is done, but you are not. There is 
more mathematics yet to learn about, and more mathematics yet to create. And 
I don’t mean to say that you should write go and write fan fiction. I’m no author, 
and you are no mere reader. You have worked through the exercises, you have 
thought about this material in your own way—so you are the author of your own 


understanding, and you must keep writing. 


—the so-called “author” 


° Or even a bad novel. 


* Or even. 


Answers to Exercises 


Answers for 1.8 


Me i B,@® <i il 5. 1 6. O 
Answers for 2.7 


n-co 


1 
1. lim n?/(2n?+1) = 1/2 2 lim 5/(21/"+14)=1/3 3. )’ = diverges, so 
noo n 
n=1 


=) il 

ES diverges 4.-3/2 5.11 6.20 7.3/4 8.3/2  9.3/10 
it 

iI 


Answers for 3.1 


ile A 2.1 3. converges 4. converges 5. converges 6. diverges 


Answers for 3.2 


1. diverges 2. diverges 3. converges 4. converges 5. converges 6. con- 
verges 7. diverges 8. converges 9. N=5 10. N = 10 11. N = 1687 


12. any integer greater than ewe 


Answers for 3.3 


1. converges 2. converges 3. converges 4. diverges 5. diverges 6. diverges 
7. converges 8. diverges 9. converges 10. diverges 
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Answers for 3.4 


Answers for 4.1 


1. converges absolutely 2. diverges 3. converges conditionally 4. converges 
absolutely 5. converges conditionally 6. converges absolutely 7. diverges 8. 
converges conditionally 


Answers for 4.2 


1. converges 2. converges 3. diverges 4. converges 5. 0.90 6. 0.95 


Answers for 6.3 


lo Ri, fS(l,l) 2 R=co, f= (6,69) 5 R=EQv=Ceeq ~& R=e@ 
I=(2-e,2+e) 5. R=O, converges only whenx=2 6.R=1,I1=[-6,-4] 7. 


co 


There are many choices—for instance, see Exercise 5—but sy n!- x" works. 


n=0 
Answers for 6.4 
1. the alternating harmonic series 2. Ss (ab Der y (n+1)(n+2)x" 4, 
n=0 n=O 
- 1 2 — -1 
aus ese R= 8. C4 ne 
n=0 2 n=0 (n+ 1)(n+2) 
Answers for 7.1 
= n 2n ! . i ff) = alsSe)e 
I) G1) / Gn) Rca ni ees.) el) et 
n=0 n=0 n=0 
= lear ~ (x-2)" 
iB 4. n 1 ( , ig ; = 
Y(-1) ——, R= 1 8. log(2) + (1) a R=2 6 
n=1 n=1 
~ 4 1-3-5---(2n-1) = (2n-1)! 
n n — | <a | 
GY GyiG=1)) R=1 7.14 2) Tr x"=14 2s Baal ; 


Answers for 7.2 


2, A 6 12 3 5 


Xs 
1l1- t - Pees 2. 1000; 8 Bh Bes) { 5 acer sell W7/, 
2 24 720 15 


Answers for 7.2 


1. diverges 2. converges 3. converges 4. diverges 5. diverges 6. di- 
verges 7. converges 8. converges 9. converges 10. converges 11. con- 
verges 12. converges 13. converges 14. converges 15. converges 16. 
converges 17. diverges 18. (-c,00) 19. (-3,3) 20. (-3,3) 21. (-1,1) 
22. radius is O—it converges only when x = 0 23. (—V3, V3) 24. (co, 0) 


<1 (In(2))"_,, =) (Ge eon 2 2n+1 
25. ies aes 26. Ds x 27. gece 28. 14+x/2+ 
= 


ah teh n+1 = ap il 
Sonn eae 29 Syne" 30 y (-1)" ont 31. n= 
oi — ‘antl : 
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Index 


p-series, 63 


alternating harmonic series, 93 


arithmetic progression, 18 
associativity, 47 


Basel problem, 62 


Cauchy condensation test, 59 
chiastic rule, 48 
commutativity, 47 
comparison test, 57 

limit, 101 
condensed series, 59 
convergent sequence, 23 
convergent series, 40 


distributive law, 45 
divergence test, 52 
divergent sequence, 23 
divergent series, 40 


geometric series, 41 
geometric progression, 19 


harmonic series, 54 
alternating, 93 


infinite series, see series 
integral test, 76 
interval of convergence, 109 


limit comparison test, 101 
limit of a sequence, 23 


Maclaurin series, 119 


p-series, 76 
partial sums, 39 
power series, 106 


radius of convergence, 109 


sequence, 12, 14 
bounded, 34 
bounded above, 34 
bounded below, 34 
convergent, 23 
decreasing, 33 
divergent, 23 
equality, 16 
increasing, 33 
index, 14 

initial, 14 
monotonic, 33 
non-decreasing, 33 


non-increasing, 33 
of partial sums, 39 
subsequence, 26 
term, 14 

series, 12 
p-series, 76 
absolute convergence, 90 
alternating harmonic, 93 
condensed, 59 
conditional convergence, 91 
convergent, 40 
divergent, 40 
geometric, 41 
harmonic, 54 
integral test, 76 
interval of convergence, 109 
Maclaurin, 119 
radius of convergence, 109 
Taylor, 123 
telescoping, 50 
value of, 40 

subsequence, 26 


Taylor series, 123 
telescoping series, 50 


value of series, 40 


